Skip to main content
BMC Public Health logoLink to BMC Public Health
. 2021 Mar 31;21:630. doi: 10.1186/s12889-021-10669-0

Syringe service program-based telemedicine linkage to opioid use disorder treatment: protocol for the STAMINA randomized control trial

Dennis P Watson 1,, James A Swartz 2, Lisa Robison-Taylor 3, Mary Ellen Mackesy-Amiti 4, Kim Erwin 5, Nicole Gastala 6, Antonio D Jimenez 7, Monte D Staton 8, Sarah Messmer 9
PMCID: PMC8010496  PMID: 33789642

Abstract

Background

A key strategy for mitigating the current opioid epidemic is expanded access to medications for treating opioid use disorder (MOUD). However, interventions developed to expand MOUD access have limited ability to engage opioid users at higher levels of overdose risk, such as those who inject opioids. This paper describes the study protocol for testing STAMINA (Syringe Service Telemedicine Access for Medication-assisted Intervention through NAvigation), an intervention that engages high-risk opioid users at community-based syringe service programs (SSP) and quickly links them to MOUD using a telemedicine platform.

Methods

This randomized control trial will be conducted at three SSP sites in Chicago. All participants will complete an initial assessment with a provider from a Federally Qualified Health Center who can prescribe or refer MOUD services as appropriate. The control arm will receive standard referral to treatment and the intervention arm will receive immediate telemedicine linkage to the provider and (depending on the type of MOUD prescribed) provided transportation to pick up their induction prescription (for buprenorphine or naltrexone) or attend their intake appointment (for methadone). We aim to recruit a total of 273 participants over two years to provide enough power to detect a difference in our primary outcome of MOUD treatment linkage. Secondary outcomes include treatment engagement, treatment retention, and non-MOUD opioid use. Data will be collected using structured interviews and saliva drug tests delivered at baseline, three months, and six months. Fixed and mixed effects generalized linear regression analyses and survival analysis will be conducted to compare the probabilities of a successful treatment linkage between the two arms, days retained in treatment, and post-baseline opioid and other drug use.

Discussion

If successful, STAMINA’s telemedicine approach will significantly reduce the amount of time between SSP clients’ initial indication of interest in the medication and treatment initiation. Facilitating this process will likely lead to stronger additional treatment- and recovery-oriented outcomes. This study is also timely given the need for more rigorous testing of telemedicine interventions in light of temporary regulatory changes that have occurred during the COVID-19 pandemic.

Trial registration

ClinicalTrials.gov (Clinical Trials ID: NCT04575324 and Protocol Number: 1138–0420). Registered 29 September 2020. The study protocol is also registered on the Open Science Framework (DOI 10.17605/OSF.IO/4853 M).

Keywords: Telehealth, Syringe exchange, Medication assisted treatment, Medication for opioid use disorder, Substance use disorder

Background

The United States has been battling an opioid epidemic for more than 20 years. The crisis, initially fueled by overprescribing, has been increasingly driven by illicitly-obtained synthetic opioids (primarily fentanyl) since 2015 [1]. A key strategy for mitigating the epidemic is expanded access to medications for treating opioid use disorder (MOUD), which include methadone, buprenorphine, and injectable naltrexone. When used appropriately, all three medications are demonstrated to be superior to alternative, non-medication-based treatments in improving outcomes (e.g., opioid cravings and use, overdose, and resulting mortality) for people living with opioid use disorder (OUD) [25]. However, interventions developed to expand MOUD access, while beneficial, remain limited in their ability to engage opioid users at higher levels of overdose risk, such as those who inject. This is because such interventions often require individuals to initiate treatment seeking from a healthcare system they might not fully trust [6], or they rely on emergency medical services as a mechanism of post-overdose engagement [710]. One possible solution is to develop interventions that engage high-risk opioid users in trusted settings and link them to MOUD as rapidly as possible after they indicate interest in treatment. STAMINA (Syringe Service Telemedicine Access for Medication-assisted Intervention through NAvigation) is an intervention developed to address these issues by engaging individuals at a community-based syringe service program (SSP) and then quickly linking them to MOUD using a telemedicine platform. This paper describes the study protocol that aims to assess the effectiveness of STAMINA as an MOUD treatment linkage intervention.

The STAMINA intervention is located in an SSP setting where the primary purpose is providing free access to sterile syringes for people who inject drugs [11]. Ancillary services also provided at the SSP include linkage to medical care and substance use disorder treatment. The rationale for locating STAMINA in an SSP is because they are generally perceived to be judgment-free areas where users of illicit drugs feel more comfortable accessing services than they might in other healthcare settings. For instance, previous research has demonstrated SSP clients are comfortable with and trusting of SSP staff and the information provided to them [6, 1215]. Client acceptability and satisfaction with SSP services are likely driven by the harm reduction approach employed, which emphasizes low-barrier services aimed at reducing risks associated with drug use, while offering (but not requiring) connection to formal treatment and healthcare services [16]. Additionally, a vast array of studies have demonstrated SSP services can improve outcomes specifically for injection drug users. Most notably, SSPs are demonstrated to reduce risky injection behaviors [11, 1719] and reduce HIV transmission [17, 20, 21]. Additional studies have demonstrated enhanced SSP-related benefits when services are combined with MOUD and other types of substance use disorder treatment [11, 19, 22]. However, while SSP clients often express interest in treatment, thereby affording a potentially important opportunity for treatment linkage [2325], assessments of the actual engagement rates have ranged from 5 to 70%; with neither the factors underlying this variability nor the optimal way to facilitate treatment linkage being well understood [11, 24, 2635].

STAMINA comprises five primary components. First, a private physical space in the SSP is used to carry out intervention procedures. Second, staff conduct a brief interview to assess MOUD interest. Third is a same-day secure, video-based telemedicine appointment with a provider who can offer treatment (either directly or through referral) with all three MOUD types. Fourth, rideshare-based transportation assistance is provided to each participant at one time point depending on the MOUD prescribed by the telemedicine provider: (a) for participants determined to be best treated with buprenorphine or naltrexone, an immediate rideshare to the pharmacy is offered to facilitate pick up the induction dose of their medication and (b) for participants prescribed methadone, a rideshare is offered for their scheduled intake appointment. Fifth, is the ability to cover the cost of the induction medication for those prescribe buprenorphine or naltrexone who do not have another payment source. As a linkage-only intervention, STAMINA does not provide any ongoing supports, which are instead provided by SSP staff and/or the treatment provider.

A handful of prior randomized control trials have demonstrated mixed results related to SSP-based OUD treatment linkage interventions. For instance, three separate trials have tested treatment referral with case management services against standard referral [26, 34, 36]; however, only one by Strathdee et al. [34] saw improved outcomes in the experimental arm. Kidorf and colleagues [28, 30, 37] have conducted three trials comparing various monetary incentive-based approaches to other linkage models (e.g., motivation sessions, low threshold services, and standard referral). Two of these trials [28, 30] demonstrated improved linkage or engagement for those who received monetary incentives, and the third [37] showed no difference between groups.

There are a number of differences among these previously tested interventions that might account for their variable performance. For instance, time between intervention start and treatment linkage can be up to 7 days [26, 34]—shortening this window is likely to improve patient follow-through with referral [38, 39]. Additionally, many prior studies mandated counseling or motivational sessions as part of the tested intervention or as part of general research participation [28, 30, 37]. However, requiring engagement in psychosocial services has been noted as a potential barrier to MOUD participation [40]. STAMINA addresses these weaknesses using a telemedicine model for same-day treatment linkage and medication induction without additional service requirements.

The STAMINA trial will also provide much needed knowledge related to the telemedicine approach. While, embedding and MOUD provider at an SSP would hypothetically result in similar reductions in linkage and medication induction times as telemedicine, there is limited research regarding such approaches [41]. Moreover, telemedicine is potentially more feasible to implement, cost effective, and sustainable for SSP settings. However, there have been considerable barriers to telemedicine implementation for MOUD (e.g., lack of reimbursement, use restricted to largely rural populations, staffing requirements, prior in-person examination requirements, and types of medications that can be prescribed) that have prevented its widespread use [42, 43]. This is unfortunate, as prior research has shown telehealth interventions—which include telemedicine—to be associated with higher patient satisfaction and equal effectiveness when compared to in-person treatment for OUD and other substance use disorders [44]. Recently, the coronavirus disease 2019 (COVID-19) pandemic has led to relaxation in federal guidelines for telemedicine-based MOUD treatment that has led to wider implementation [45, 46]. However, these changes were originally set to expire in December of 2020 and have not been made permanent at this time this manuscript was developed. As such, there is a need for both observational studies related to these policy changes and rigorous clinical trial knowledge to assess the benefits of telemedicine for OUD treatment.

The STAMINA trial will follow a parallel randomized design. The primary question guiding the trial is whether the STAMINA intervention improves MOUD linkage above referral as usual. Additionally, there is a goal to understand the potential effect of STAMINA on MOUD engagement and retention and illicit opioid use. The primary hypothesis is that (1) STAMINA will be more effective at improving MOUD linkage than standard referral. Secondary hypotheses are: (2) the STAMINA participants will have greater MOUD engagement than participants who receive standard referral; (3) STAMINA participants will have greater MOUD retention than participants who receive standard referral; (4) STAMINA participants will have used less illicit opioids at follow-up than participants who received standard referral.

Methods1

Study setting

The study will be conducted at three Chicago-based and university-affiliated SSP sites. The sites are located in different areas of the city and serve demographically diverse local populations. For example, the SSPs on Chicago’s west and south sides serve primarily an African American/Black clientele, 83.0 and 93.2% respectively, whereas the northwest side office serves a higher percentage of Latinx clients (52.0%). To assure the aggregate study sample captures both the geographical as well as racial/ethnic diversity of SSP clients, the study will recruit and enroll participants at each of the locations. Initial MOUD treatment assessment will be provided by a university-affiliated Federally Qualified Health Center (FQHC) that can prescribe buprenorphine and naltrexone and has a relationship with a methadone treatment provider to whom patients can be referred as appropriate. Trial participants prescribed buprenorphine or naltrexone can receive MOUD treatment at any of the 6 FQHC locations across the city, three of which are in close proximity to SSP sites. Additionally, induction buprenorphine and naloxone prescriptions can be dispensed from the main FQHC office at no cost to study participants who lack a payment source. The FQHC can also refer to methadone clinics in various locations throughout the city.

Potential participants

A power analysis determined a minimum sample size of n = 273 is needed to detect an odds ratio of 2.0 for a binary predictor (the intervention effect) in a logistic regression with 80% power. The control group’s proportion of successful treatment initiation was set at 0.35. Assuming an 80% study retention rate across all three waves of data collection, the recruitment goal has been set at n = 350 total participants (n = 175 for each arm).

To be included in the study, potential participants must: communicate verbally in English, be at least 18 years of age, reside in Cook County, Illinois, meet clinical criteria for a past-year opioid use disorder of any severity level [47], and express interest in receiving MOUD treatment. Exclusion criteria include: having plans to move outside of Cook County, Illinois within the next six months; under criminal justice supervision that requires serving a jail or prison sentence within the next six months; experiencing severe withdrawal symptoms as indicated by the Clinical Opiate Withdrawal Scale [48]; currently taking any medication prescribed to them by a healthcare provider to treat OUD; or demonstrating inadequate ability to provide informed consent.

Study arms and allocation process

Participants will be assigned to one of two study arms using randomization with stratification by site and whether or not they indicate a strong preference for methadone treatment. The reason for stratifying assignment on this second condition is to avoid potential confounding of the results since methadone treatment will be administered by a different provider and (as described below) require different linkage procedures after the telemedicine call. Allocation will be determined in advance of enrollment by randomizing pre-established study identification numbers that will be sequentially assigned to participants as they are enrolled.

Intervention arm participants will have their vitals taken and shared with a provider (a medical doctor, physician’s assistant, or nurse practitioner who is waivered to prescribe buprenorphine) at the beginning of the telemedicine video call, which will be conducted via a tablet computer. If buprenorphine or naltrexone is prescribed, the provider will schedule a follow-up visit, and the participant will be provided instructions for home induction and offered immediate rideshare transportation to the FQHC’s pharmacy. For methadone, the provider will make a referral, and the research assistant will immediately assist the participant to make an appointment and offer to arrange a rideshare for the intake visit. Researchers will also provide an immediate rideshare to the FQHC’s pharmacy if the provider prescribes medication to assist with any withdrawal symptoms the patient might experience until the methadone intake appointment. Participants assigned to the control arm will be given a standard referral for an in-person intake appointment at an FQHC location or methadone clinic, and researchers will make every attempt to ensure thee appointments occur within 24–72 h of enrollment. Control participants will also be provided with two one-way bus passes if transportation assistance is needed. Patients in both arms will have access to all services offered by the FQHC or methadone clinic, and continuing treatment for both arms will be provided following the organization’s (e.g., FQHC or methadone clinic) general standard of care.

Though unlikely given the population, it is possible a provider could assess a participant from either arm as being inappropriate for MOUD treatment. If this occurs, the provider’s decision will be noted, and the patient will continue to be followed up with for the normal study duration.

Measures

Basic demographic information on all participants will be collected at baseline, as well as data reflecting social support, child welfare involvement, alcohol use, opioid cravings, overdose experiences, past-year and past-month drug use and treatment, chronic health conditions (see [49]), psychological health (see [50]), trauma exposure, and patient comfort with telemedicine or in-person MOUD intake.

The primary outcome is linkage to MOUD treatment, which is defined as whether or not the participant attends one MOUD treatment appointment within 14 days of study enrollment [49] and measured using administrative FQHC and methadone provider treatment data. As the intervention group would automatically meet this outcome after their initial telemedicine call, only those appointments made after participants leave the enrollment site will be counted. There are three secondary outcome measures: (1) MOUD treatment engagement, defined as attending a minimum of two OUD-related treatment appointments within 34 days of study enrollment [51] will measured using administrative data from providers that tracks reasons for the treatment appointment and whether they were kept or not. (2) MOUD treatment retention will also be measured using administrative data and defined as the number of days the patient is actively engaged in treatment, with active engagement being defined as (a) not being discharged from care or (b) going no more than 14 days without medication. The operationalization for this outcome will differ depending on the MOUD: 15 or more days without renewing a buprenorphine prescription, missing 15 or more consecutive methadone doses, or 45 or more days since the last naltrexone injection. Participants will still be considered engaged if they switch to a different MOUD with the 14-day window. (3) Non-MOUD opioid use will be measured in two ways: (a) self-reported days of non-prescribed/medically supervised opioid use in the past 30 days using questions from the National Survey on Drug Use and Health [52] modified to ask about separate known use of heroin, fentanyl/carfentanil, and prescription painkillers; and (b) detection of illicit opioids through a saliva test administered at the time of data collection. Self-reported treatment linkage and engagement data for any care received from outside of the study’s treatment partners will be collected (in addition to the FQHC’s administrative records) to understand if participants engaged in treatment with another provider. In addition to measuring these outcomes, additional information will also be collected related to: all cause and opioid-related mortality from state vital records, self-reported criminal justice involvement, and health-related quality of life using the current quality of life scale [53].

Procedures

Table 1 displays the expected participant timeline for the study. Recruitment will occur at SSP locations. Potential trial participants will be identified one of two ways: (1) they will see recruitment materials posted and request more information from SSP staff or (2) SSP staff will inform clients who indicate treatment interest of the opportunity to participate in the trial. SSP staff will then refer interested individuals to research staff. Research staff will provide more detailed information, conduct an eligibility assessment based on the previously listed inclusion and exclusion criteria, and complete the initial consent process with those deemed eligible to participate.

Table 1.

Participant timeline

Study Period
Enrollment Allocation Post-allocation Close-out
Time point -t1 0 t1 (baseline) t2 (3 months) t3 (6 months)
ENROLLMENT:
 Eligibility assessment x
 Informed consent x
 Allocation x
DATA COLLECTION:
 Baseline characteristics x
 Telemedicine preference x
 Treatment linkage, engagement, & retention (FQHC records) x x
 Opioid use (self-report) x x x
 Criminal justice involvement (self-report) x x x
 Quality of life (self-report) x x x
 Mortality (state vital records) x x
 Drug test x x x
INTERVENTION:
 Telemedicine Linkage x
 Standard referral x

After consent is obtained, research staff will collect baseline data using a structured questionnaire and administer a 14-panel saliva drug test. After all data are collected, research staff will then open a sealed envelope containing a card informing them of the trial arm to which the participant’s sequential study identification number has been assigned. Depending on the arm assignment, the participant will then receive a telemedicine visit or standard referral.

Participants will be asked to return to the SSP for three- and six-month follow-up data collection. On-site research staff will administer the saliva test and connect them by phone to off-site research staff who will not know the participant’s arm assignment to complete the structured questionnaire. Participants will receive a $25 incentive for completing baseline data collection. At follow-up interviews, they will receive $35 (to accommodate the additional travel time to and from the interviews) and will also be offered public transportation passes to accommodate any travel expenses accrued.

Following procedures outlined by Scott et al. [54], research personnel will utilize the client contact information obtained during the baseline interview to locate and retain participants for follow-up data collection activities. Approximately one week following baseline, research personnel will attempt to verify all contact information provided by the participant, including the contact information for their friends, family, and other associates. One month in advance, research personnel will attempt to contact the participant to schedule each follow-up. If research staff are unable to contact the participant directly, the contact information for friends, family, or other associates will be utilized.

To protect participant confidentiality, all data will be stored in the HIPAA-compliant Research Electronic Data Capture (REDCap) system [55]. Only limited members of the research team will have access to this REDCap project via their personal, password protected login information. Further, study identification numbers will only be connected to participants’ names in REDCap. A secure Box Health account will be used to store data obtained from participant records, which will be shared using a secure transfer process. All completed informed consent documents will be stored in a secure and locked location. A certificate of confidentiality (CC-OD-20-900) has been received from the National Institute on Drug Abuse to provide an added layer of legal protections for participants’ data. Finally, if researchers must reach out to identified contacts to locate participants, they will only inform the contact that the participant is in a research study for which particular details cannot be discussed.

All protocols are outlined in the study’s protocol and procedures manual. All research assistants must read this manual, role play completing the interviews from both the research assistant and participant perspectives, complete two full mock enrollments, and competently carry out an observed enrollment of a true participant before they can work alone. Research assistants float among the data collection sites, rather than being assigned to a particular one. The project manager uses a checklist to complete at least one fidelity review a month with each research assistant, and their performance is reviewed with them.

Data analysis

To assess the first hypothesis, multivariable, binary logistic regression models will be used with linkage (yes/no) as the dependent variable. The primary independent variable in these models will be a dichotomous indicator for treatment condition (0 = control arm; 1 = intervention arm). Possible additional predictors to assess the effects on outcomes as well as potential interaction effects will include, at a minimum: demographics (age, sex, race/ethnicity), employment status, baseline severity of substance use disorder, baseline severity of psychological distress, withdrawal severity at enrollment, any homelessness in the past three months (dichotomous) number of past overdose experiences, and whether treatment assignment matched expressed treatment preference at baseline. The effects of SSP location will also be measured as a trichotomous variable to represent each of the three COIP sites. Finally, as there could be differences in the primary outcome owing to the MOUD treatment participants receive, we plan on including treatment assignment as an additional model predictor. We can then test if there is an interaction between MOUD received and treatment condition. As indicated above, the study is powered to detect a two-fold increase in the odds of treatment initiation for participants in the treatment condition relative to the odds of linkage for participants in the control/standard referral condition.

Regarding the other three hypotheses, secondary outcomes such as treatment engagement, treatment retention, and past 30-day opioid use can be modeled using generalized linear mixed effects models with random intercept terms included for participants, reflecting the repeated measures nature of the study data. The type of regression model will be selected based on the expected distribution of the dependent variable (e.g., binary logistic for dichotomous dependent variables; and Poisson or negative binomial regressions for count data). An alternate measure of retention is to assess how long each participant remained in treatment defined as being either the last treatment appointment kept, or participant’s self-report of the date they discontinued using the MOUD prescribed. The time to discontinuation of treatment/medication can then be modeled using survival analysis or proportional hazard models. These models provide information on how long persons remain in treatment allowing comparisons of the survival times (or conversely, periods of highest risk for dropping out of treatment) by study condition as well as other covariates.

The effects of missing data on the analysis will be handled according to the amount of missing data. If only a small proportion (< 5%) of cases have missing data on the dependent variable and model predictors, simple listwise deletion will be used [56]. If there is a larger proportion of cases with missing data, the pattern of missingness on model covariates will first be examined to determine if any particular covariate is disproportionately contributing to the missing data. By creating a dichotomous indicator for each covariate to indicate missing or not, preliminary bivariate regression models can be run for each dependent variable to determine if missing cases significantly differ from non-missing cases related to the outcomes of focus. The models will then be estimated using listwise deletion. Next, the models will be re-estimated using full information maximum likelihood within a structural equation or a generalized structural equation framework [57, 58]. Comparison of the two sets of results will provide a sensitivity analysis of the effects of missing data on parameter estimates.

Data safety and monitoring

The Principal Investigators (DPW and JAS) will be responsible for all data oversite. Data will be reviewed for quality as it is acquired, and, any problems identified will be noted and feedback will be provided to research staff. Prior to each quarterly Data Safety and Monitoring Board (DSMB) meeting, an analysis will be conducted of existing data to identify potential negative trends. All significant negative trends and adverse events will be discussed in detail with the DSMB (comprising three individuals with randomized control trial, substance use disorder, syringe exchange populations, and MOUD treatment among them) to assess whether they resulted from involvement in the study or other possible factors. If a link between study involvement and negative trends or adverse events is established, a review will be conducted to understand whether these differences are related to amenable study procedures. If negative trends are demonstrated to be related to the study, data collection will be stopped. Subject withdrawals and any complaints will be monitored to ensure study procedures designed to protect the privacy and confidentiality of participants are adequate and no unanticipated distress or unintended outcomes have resulted from any of the study procedures. In addition, the institutional review board and DSMB will be notified within 24 h of any unexpected and serious adverse events that could potentially be related to study involvement, and the researchers will conduct a review of study protocols and procedures to identify corrective measures.

Ancillary and post-trial care

After the end of the study, trial participants will be able to continue receiving services at the provider they are receiving treatment from and the SSP indefinitely.

COVID-19 considerations

COVID-19 is having direct impacts on opioid users that need to be considered and accounted for during the trial’s course. For instance, social distancing can result in isolation that cuts people off from the supports that are an important component of recovery [59, 60]. People who use opioids are also at greater risk of complications and death if they do catch the virus [60]. The temporary relaxation of telemedicine guidelines has changed treatment standards since this project was initially conceived, and this might impact the ability to see a difference in secondary outcomes since telemedicine improves access and will be available to both groups for their appointments after initial MOUD linkage. Given sample size calculations were completed in a pre-COVID-19 context, assumptions underlying the power analysis will be re-checked after the first 100 participants have been enrolled, appropriate adjustments will be made. Additionally, all procedures described above will now be performed with limited interactions between participants and staff to decrease risk of COVID-19 transmission. To accomplish this, SSP staff will place participants in a room and off-site research staff will conduct data collection using video conferencing technology. Onsite research staff (wearing personal protective equipment) will be available to obtain consent, complete drug testing, take vitals, and provide the research incentive. Finally, the pandemic might result in difficulties with follow-up data collection. If follow-up rates dip below 85% in any one month, participants will be given the option to complete all data collection over the phone and saliva tests will be optional. Furthermore, the follow-up incentive will be split--$25 for the interview and $10 for the saliva test—to ensure those who choose to complete saliva testing are appropriately compensated for their travel time.

Discussion

The STAMINA intervention was developed to improve MOUD treatment linkage for a highly vulnerable population of opioid users who are unlikely to engage with alternate linkage strategies that are often integrated within the traditional healthcare system and/or rely on a post overdose event as the route for identifying patients [610]. If successful, the telemedicine approach will significantly reduce the time between an individual’s indicating interest in initiating MOUD treatment and speaking to a provider. By facilitating and shortening this process, it is hoped participants will achieve improved treatment- and recovery-oriented outcomes (e.g., engagement, retention, reduced substance use, etc.) [38, 39].

A primary limitation of the study design is reliance on participant self-report for certain measures. While saliva tests are being in addition to self-reported substance use, the tests are largely unable to identify many drugs after 24–48 h. While urine tests have potential to identify some substances further out, the community advisory board made up of SSP staff and former and current opioid users advised that saliva testing would be considered less invasive by participants. STAMINA researchers are establishing a relationship with the clinic to which the FQHC will refer methadone participants for the purpose of obtaining treatment-related administrative data. Failure to establish this relationship will mean the only treatment data available from participants referred to the clinic will be self-reported.

Relatedly, it is possible that the partner FQHC will start providing methadone treatment during the course of the study. Implementation of their methadone program was scheduled to be completed before the trial began but was paused due to the COVID-19 pandemic. As a result, participants enrolled who express a strong or exclusive interest in methadone treatment, and do so prior to the FQHC receiving approval, will be referred to the methadone treatment provider. Participants enrolled after the FQHC is approved for methadone treatment will be referred to the FQHC. There will thus be a potential confound if there are provider differences in initiation or engagement. The methadone provider will be recorded as a variable, allowing statistical control for program effects, but random assignment to a methadone provider is not possible.

Possible provider effects are another limitation. However, the same providers deliver both telemedicine and in-person treatment, and this reduces the likelihood of provider effects confounding results between the two treatment conditions. Furthermore, we will be able to track which providers patients see, which will allow us to investigate possible confounding by capturing provider effects as a dummy-coded fixed effect in the regression models to test if there are any differential outcomes by assigned provider.

Finally, the data collected in the trial is limited in its ability to describe in any detailed fashion participants’ experiences with the different types of treatment, which could be beneficial for explaining trial outcomes and making improvements for future research and replication. To address this limitation, we plan to conduct a nested qualitative study [61]. However, the exact questions guiding this effort will be informed by formative trial results identified after the first 100 participants complete their first 3-month follow-up.

Interventions are needed that can identify the most vulnerable users of opioids and rapidly connect them to treatment. The STAMINA intervention attempts to fill this gap using an SSP-based telemedicine linkage model. Should STAMINA prove to be a stronger alternative to referral as usual, next steps will be to understand the intervention’s cost effectiveness and how it might be replicated in other areas despite recognized issues such as limited SSP coverage, wide ranging variations in SSP service quality, and “not in my backyard attitudes” that are likely barriers to implementation [6264].

Acknowledgements

The authors would like to acknowledge and thank Christy Scott, Michael Dennis, Christine Grella, Brad Ray, Karla Wagner, and Juleigh Nowinski-Konchack for their advice and continued support related to the study. We would also like to thank the members of our Community Advisory Board and staff at Community Outreach Intervention Projects for their input into the intervention design and research protocols. We would like to thank Adrian Politzer, the graphic designer who led development of all participant-facing materials. We would also like to thank Noah Tye and Dillon Thorpe who are the research assistants conducting enrollment and data collection activities for the study.

Abbreviations

COVID-19

Coronavirus disease 2019

DSMB

Data safety and monitoring board

FQHC

Federally Qualified Health Center

MOUD

Medications for opioid use disorder

OUD

Opioid use disorder

SSP

Syringe service program

STAMINA

Syringe Service Telemedicine Access for Medication-assisted Intervention through Navigation

Authors’ contributions

DPW, JAS, and LRT led development of this manuscript. MMA contributed significantly to the statistical design. NG, ADJ, and SM provided significant input into the intervention and research protocol design to ensure it maps to the FQHC and SSP workflows. KE led feasibility testing and refinement of all processes and protocols. MS gave additional input into the protocol development. All authors gave input into the development of this manuscript and approved the final version.

Authors information

DPW and JAS are multiple principal investigator for this study. MMA, NG, ADJ, MS, and SM are study co-investigators. KE is a human centered design expert who assisted with intervention and protocol design. LRT is the study project manager. All authors read and approved the final manuscript.

Funding

This study is supported by funding from Arnold Ventures. The study design was developed by the researchers with minimal input from the funder, which included information regarding their stated funding priorities. The funder’s board reviewed and approved the application, which included the study design. The funder did not participate in the development of or review the current manuscript before its submission for peer review. Ideas and statement presented in the manuscript are those of the authors and do not necessarily represent those of the funder.

Availability of data and materials

Due to the sensitivity of information related to substance use and treatment, the dataset will only be available upon request and with proper data use agreements in place. All materials developed for the study are available to be shared upon request.

Declarations

Ethics approval and consent to participate

All procedures involving human subjects were approved by the Institutional Review Board of Chestnut Health Systems (#1138–0420), and a reliance agreement was used to establish a single IRB process with the University of Illinois at Chicago. Written informed consent will be requested of all participants prior to trial enrollment.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to declare.

Footnotes

1

Trial status: Data collection for this trial started on August 24th, 2020 at the lowest volume site and was paused due to the implementation of new administrative rules regarding COVID-19 and study safety. As such, 5 participants have been enrolled at the time the manuscript was originally submitted for peer review on October 28, 2020. The other two sites are scheduled to go live in early to mid-November 2020.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Dennis P. Watson, Email: dpwatson@chestnut.org

James A. Swartz, Email: jaswartz@uic.edu

Lisa Robison-Taylor, Email: ldrobiso@uic.edu.

Mary Ellen Mackesy-Amiti, Email: mmamiti@uic.edu.

Kim Erwin, Email: kim.erwin.007@gmail.com.

Monte D. Staton, Email: staton@uic.edu

Sarah Messmer, Email: messmer2@uic.edu.

References

  • 1.Ciccarone D. The triple wave epidemic: supply and demand drivers of the US opioid overdose crisis. Int J Drug Policy. 2019;71:183–188. doi: 10.1016/j.drugpo.2019.01.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Renner JA, Crawford MB. Medication for the treatment of opioid use disorder. In: Kelly JF, Wakeman SE, editors. Treating opioid addiction. New York: Springer; 2019. pp. 89–107. [Google Scholar]
  • 3.Fullerton CA, Kim M, Thomas CP, Lyman DR, Montejano LB, Dougherty RH, Daniels AS, Ghose SS, Delphin-Rittmon ME. Medication-assisted treatment with methadone: assessing the evidence. Psychiatr Serv. 2014;65(2):146–157. doi: 10.1176/appi.ps.201300235. [DOI] [PubMed] [Google Scholar]
  • 4.Jarvis BP, Holtyn AF, Subramaniam S, Tompkins DA, Oga EA, Bigelow GE, et al. Extended-release injectable naltrexone for opioid use disorder: a systematic review. Addiction. 2028;113(7):1188–1209. [DOI] [PMC free article] [PubMed]
  • 5.Thomas CP, Fullerton CA, Kim M, Montejano L, Lyman DR, Dougherty RH, Daniels AS, Ghose SS, Delphin-Rittmon ME. Medication-assisted treatment with buprenorphine: assessing the evidence. Psychiatr Serv. 2014;65(2):158–170. doi: 10.1176/appi.ps.201300256. [DOI] [PubMed] [Google Scholar]
  • 6.Treloar C, Rance J, Yates K, Mao L. Trust and people who inject drugs: the perspectives of clients and staff of needle syringe programs. Int J Drug Policy. 2016;27:138–145. doi: 10.1016/j.drugpo.2015.08.018. [DOI] [PubMed] [Google Scholar]
  • 7.Scott CK, Dennis ML, Grella CE, Nicholson L, Sumpter J, Kurz R, et al. Findings from the recovery initiation and management after overdose (RIMO) pilot study experiment. J Subst Abus Treat. 2019;108:65–74. doi: 10.1016/j.jsat.2019.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Watson DP, Brucker K, McGuire A, Snow-Hill NL, Xu H, Cohen A, et al. Replication of an emergency department-based recovery coaching intervention and pilot testing of pragmatic trial protocols within the context of Indiana’s opioid state targeted response plan. J Subst Abus Treat. 2019;108:88–94. doi: 10.1016/j.jsat.2019.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Samuels EA, Bernstein SL, Marshall BDL, Krieger M, Baird J, Mello MJ. Peer navigation and take-home naloxone for opioid overdose emergency department patients: preliminary patient outcomes. J Subst Abus Treat. 2018;94:29–34. doi: 10.1016/j.jsat.2018.07.013. [DOI] [PubMed] [Google Scholar]
  • 10.D’Onofrio G, O’Connor PG, Pantalon MV, Chawarski MC, Busch SH, Owens PH, Bernstein SL, Fiellin DA. Emergency department-initiated buprenorphine/naloxone treatment for opioid dependence: a randomized clinical trial. JAMA. 2015;313(16):1636–1644. doi: 10.1001/jama.2015.3474. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hagan H, McGough JP, Thiede H, Hopkins S, Duchin J, Alexander ER. Reduced injection frequency and increased entry and retention in drug treatment associated with needle-exchange participation in Seattle drug injectors. J Subst Abus Treat. 2000;19(3):247–252. doi: 10.1016/S0740-5472(00)00104-5. [DOI] [PubMed] [Google Scholar]
  • 12.Allen ST, Grieb SM, O’Rourke A, Yoder R, Planchet E, White RH, et al. Understanding the public health consequences of suspending a rural syringe services program: a qualitative study of the experiences of people who inject drugs. Harm Reduct J. 2019;16:1–10. doi: 10.1186/s12954-019-0305-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Treloar C, Newland J, Maher L. A qualitative study trialling the acceptability of new hepatitis C prevention messages for people who inject drugs: symbiotic messages, pleasure and conditional interpretations. Harm Reduct J. 2015;12:1–9. doi: 10.1186/1477-7517-11-34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Macneil J, Pauly B. Needle exchange as a safe haven in an unsafe world. Aust Prof Soc Alcohol Drugs. 2011;30(1):26–32. doi: 10.1111/j.1465-3362.2010.00188.x. [DOI] [PubMed] [Google Scholar]
  • 15.Cesnales NI, Witt M, Miles BK. Syringe quantity limitations: syringe exchange program participant health behavior and satisfaction. J Soc Work Pract Addict. 2019;19(4):400–413. doi: 10.1080/1533256X.2019.1659066. [DOI] [Google Scholar]
  • 16.Ashford RD, Curtis B, Brown AM. Peer-delivered harm reduction and recovery support services: initial evaluation from a hybrid recovery community drop-in center and syringe exchange program. Harm Reduct J. 2018;15(1):1–9. [DOI] [PMC free article] [PubMed]
  • 17.Fernandes RM, Cary M, Duarte G, Jesus G, Alarcão J, Torre C, et al. Effectiveness of needle and syringe programmes in people who inject drugs - an overview of systematic reviews. BMC Public Health. 2017;17:1–15. doi: 10.1186/s12889-017-4210-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Behrends CN, Li C-S, Gibson DR. Decreased odds of injection risk behavior associated with direct versus indirect use of syringe exchange: evidence from two California cities. Subst Use Misuse. 2017;52:1151–1153. doi: 10.1080/10826084.2017.1299182. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Platt L, Minozzi S, Reed J, Vickerman P, Hagan H, French C, Jordan A, Degenhardt L, Hope V, Hutchinson S, Maher L, Palmateer N, Taylor A, Bruneau J, Hickman M. Needle and syringe programmes and opioid substitution therapy for preventing HCV transmission among people who inject drugs: findings from a Cochrane review and meta-analysis. Addiction. 2018;113(3):545–563. doi: 10.1111/add.14012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Azores-Gococo NM, Fridberg DJ. Harm-reduction strategies for injection drug use. Psychiatr Ann. 2017;47(1):45–48. doi: 10.3928/00485713-20161208-01. [DOI] [Google Scholar]
  • 21.Bramson H, Des Jarlais DC, Arasteh K, Nugent A, Guardino V, Feelemyer J, Hodel D. State laws, syringe exchange, and HIV among persons who inject drugs in the United States: history and effectiveness. J Public Health Policy. 2015;36(2):212–230. doi: 10.1057/jphp.2014.54. [DOI] [PubMed] [Google Scholar]
  • 22.Kidorf M, King VL, Pierce J, Kolodner K, Brooner RK. Benefits of concurrent syringe exchange and substance abuse treatment participation. J Subst Abus Treat. 2011;40(3):265–271. doi: 10.1016/j.jsat.2010.11.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kidorf M, King VL. Expanding the public health benefits of syringe exchange programs. Can J Psychiatry Rev Can Psychiatr. 2008;53(8):487–495. doi: 10.1177/070674370805300803. [DOI] [PubMed] [Google Scholar]
  • 24.Heimer R. Can syringe exchange serve as a conduit to substance abuse treatment? J Subst Abus Treat. 1998;15(3):183–191. doi: 10.1016/S0740-5472(97)00220-1. [DOI] [PubMed] [Google Scholar]
  • 25.Fox AD, Sohler NL, Frost T, Lopez C, Cunningham CO. Development and evaluation of a community-based buprenorphine treatment intervention. Harm Reduct J. 2017;14. 10.1186/s12954-017-0149-y. [DOI] [PMC free article] [PubMed]
  • 26.Bråbäck M, Nilsson S, Isendahl P, Troberg K, Brådvik L, Håkansson A. Malmö treatment referral and intervention study (MATRIS)-effective referral from syringe exchange to treatment for heroin dependence: a pilot randomized controlled trial. Addiction. 2016;111(5):866–873. doi: 10.1111/add.13249. [DOI] [PubMed] [Google Scholar]
  • 27.Henderson LA, Vlahov D, Celentano DD, Strathdee SA. Readiness for cessation of drug use among recent attenders and nonattenders of a needle exchange program. J Acquir Immune Defic Syndr 1999. 2003;32:229–237. doi: 10.1097/00126334-200302010-00017. [DOI] [PubMed] [Google Scholar]
  • 28.Kidorf M, King VL, Neufeld K, Peirce J, Kolodner K, Brooner RK. Improving substance abuse treatment enrollment in community syringe exchangers. Addiction. 2009;104(5):786–795. doi: 10.1111/j.1360-0443.2009.02560.x. [DOI] [PubMed] [Google Scholar]
  • 29.Kidorf M, Disney E, King V, Kolodner K, Beilenson P, Brooner RK. Challenges in motivating treatment enrollment in community syringe exchange participants. J Urban Health. 2005;82(3):456–467. doi: 10.1093/jurban/jti091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kidorf M, King VL, Gandotra N, Kolodner K, Brooner RK. Improving treatment enrollment and re-enrollment rates of syringe exchangers: 12-month outcomes. Drug Alcohol Depend. 2012;124(1-2):162–166. doi: 10.1016/j.drugalcdep.2011.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Kuo I, Brady J, Butler C, Schwartz R, Brooner R, Vlahov D, Strathdee SA. Feasibility of referring drug users from a needle exchange program into an addiction treatment program: experience with a mobile treatment van and LAAM maintenance. J Subst Abus Treat. 2003;24(1):67–74. doi: 10.1016/S0740-5472(02)00343-4. [DOI] [PubMed] [Google Scholar]
  • 32.Lloyd JJ, Ricketts EP, Strathdee SA, Cornelius LJ, Bishai D, Huettner S, Havens JR, Latkin C. Social contextual factors associated with entry into opiate agonist treatment among injection drug users. Am J Drug Alcohol Abuse. 2005;31(4):555–570. doi: 10.1081/ADA-200068114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Riley ED, Safaeian M, Strathdee SA, Brooner RK, Beilenson P, Vlahov D. Drug user treatment referrals and entry among participants of a needle exchange program. Subst Use Misuse. 2002;37(14):1869–1886. doi: 10.1081/JA-120014088. [DOI] [PubMed] [Google Scholar]
  • 34.Strathdee SA, Ricketts EP, Huettner S, Cornelius L, Bishai D, Havens JR, Beilenson P, Rapp C, Lloyd JJ, Latkin CA. Facilitating entry into drug treatment among injection drug users referred from a needle exchange program: results from a community-based behavioral intervention trial. Drug Alcohol Depend. 2006;83(3):225–232. doi: 10.1016/j.drugalcdep.2005.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Havens JR, Lofwall MR, Frost SDW, Oser CB, Leukefeld CG, Crosby RA. Individual and network factors associated with prevalent hepatitis C infection among rural Appalachian injection drug users. Am J Public Health. 2013;103(1):e44–e52. doi: 10.2105/AJPH.2012.300874. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Havens JR, Latkin CA, Pu M, Cornelius LJ, Bishai D, Huettner S, Rapp C, Ricketts EP, Lloyd JJ, Strathdee SA. Predictors of opiate agonist treatment retention among injection drug users referred from a needle exchange program. J Subst Abus Treat. 2009;36(3):306–312. doi: 10.1016/j.jsat.2008.07.002. [DOI] [PubMed] [Google Scholar]
  • 37.Kidorf M, Brooner RK, Leoutsakos J-M, Peirce J. Treatment initiation strategies for syringe exchange referrals to methadone maintenance: a randomized clinical trial. m. 2018;187:343–350. doi: 10.1016/j.drugalcdep.2018.03.009. [DOI] [PubMed] [Google Scholar]
  • 38.Dennis ML, Ingram PW, Burks ME, Rachal JV. Effectiveness of streamlined admissions to methadone treatment: a simplified time-series analysis. J Psychoactive Drugs. 1994;26(2):207–216. doi: 10.1080/02791072.1994.10472268. [DOI] [PubMed] [Google Scholar]
  • 39.Maddux JF, Desmond DP, Esquivel M. Rapid admission and retention on methadone. Am J Drug Alcohol Abuse. 1995;21(4):533–547. doi: 10.3109/00952999509002714. [DOI] [PubMed] [Google Scholar]
  • 40.Winograd RP, Wood CA, Stringfellow EJ, Presnall N, Duello A, Horn P, et al. Implementation and evaluation of Missouri’s medication first treatment approach for opioid use disorder in publicly-funded substance use treatment programs. J Subst Abus Treat. 2019;108:55–64. doi: 10.1016/j.jsat.2019.06.015. [DOI] [PubMed] [Google Scholar]
  • 41.Fox AD. Onsite buprenorphine treatment at syringe exchange programs. https://clinicaltrials.gov/ct2/show/NCT03150173. Accessed on October 23, 2020.
  • 42.Molfenter T, Boyle M, Holloway D, Zwick J. Trends in telemedicine use in addiction treatment. Addict Sci Clin Pract. 2015;10(1):14. doi: 10.1186/s13722-015-0035-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Huskamp HA, Busch AB, Souza J, Uscher-Pines L, Rose S, Wilcock A, Landon BE, Mehrotra A. How is telemedicine being used in opioid and other substance use disorder treatment? Health Aff. 2018;37(12):1940–1947. doi: 10.1377/hlthaff.2018.05134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Lin L (Allison) Casteel D, Shigekawa E, Weyrich MS, Roby DH, SB MM. Telemedicine-delivered treatment interventions for substance use disorders: a systematic review. J Subst Abuse Treat. 2019;101:38–49. doi: 10.1016/j.jsat.2019.03.007. [DOI] [PubMed] [Google Scholar]
  • 45.Harris M, Johnson S, Mackin S, Saitz R, Walley AY, Taylor JL. Low barrier tele-buprenorphine in the time of COVID-19: a case report. J Addict Med. 2020;14(4):e136–e138. [DOI] [PMC free article] [PubMed]
  • 46.U.S. Department of Justice, Drug Enforcement Administration. COVID_19 Information Page: telemedicine. https://www.deadiversion.usdoj.gov/coronavirus.html. Accessed 25 Jun 2020.
  • 47.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Arlington VA: Author. 2013. [Google Scholar]
  • 48.Wesson DR, Ling W. The clinical opiate withdrawal scale (COWS) J Psychoactive Drugs. 2003;35(2):253–259. doi: 10.1080/02791072.2003.10400007. [DOI] [PubMed] [Google Scholar]
  • 49.Kessler RC, Ustün TB. The world mental health (WMH) survey initiative version of the World Health Organization (WHO) composite international diagnostic interview (CIDI) Int J Methods Psychiatr Res. 2004;13(2):93–121. doi: 10.1002/mpr.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kessler RC, Green JG, Gruber MJ, Sampson NA, Bromet E, Cuitan M, Furukawa TA, Gureje O, Hinkov H, Hu CY, Lara C, Lee S, Mneimneh Z, Myer L, Oakley-Browne M, Posada-Villa J, Sagar R, Viana MC, Zaslavsky AM. Screening for serious mental illness in the general population with the K6 screening scale: results from the WHO world mental health (WMH) survey initiative. Int J Methods Psychiatr Res. 2010;19(Suppl 1):4–22. doi: 10.1002/mpr.310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.National Quality Forum . Opioids and opioid use disorder: An environmental scan of quality measures. Washington DC: Author; 2019. [Google Scholar]
  • 52.The US Substance Abuse and Mental Health Services Administration . 2018 National Survey on drug use and health: methodological summary and definitions. Washington DC: Author; 2019. [Google Scholar]
  • 53.US Centers for Disease Control and Prevention . Measuring Healthy Days. Atlanta: Author; 2000. [Google Scholar]
  • 54.Scott CK. A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug Alcohol Depend. 2004;74(1):21–36. doi: 10.1016/j.drugalcdep.2003.11.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Allison P. Why maximum likelihood is better than multiple imputation https://statisticalhorizons.com/ml-better-than-mi. Accessed 23 Oct 2020.
  • 57.Allison P. maximum likelihood is better than multiple imputation: part II https://statisticalhorizons.com/ml-is-better-than-mi. Accessed 23 Oct 2020.
  • 58.Allison P. Listwise deletion: it’s not evil https://statisticalhorizons.com/listwise-deletion-its-not-evil. Accessed 23 Oct 2020.
  • 59.Alexander GC, Stoller KB, Haffajee RL, Saloner B. An epidemic in the midst of a pandemic: opioid use disorder and COVID-19. Ann Intern Med. 2020;173(1):57–8. [DOI] [PMC free article] [PubMed]
  • 60.Volkow ND. Collision of the COVID-19 and addiction epidemics. Ann Intern Med. 2020;173(1):61–2. [DOI] [PMC free article] [PubMed]
  • 61.Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Thousand Oaks: Sage; 2011. [Google Scholar]
  • 62.Williams CT, Ouellet LJ. Misdirected opposition: evidence opposing “not in my back yard” arguments against syringe exchange programmes. Int J Drug Policy. 2010;21(5):437–439. doi: 10.1016/j.drugpo.2010.02.003. [DOI] [PubMed] [Google Scholar]
  • 63.Strathdee SA, Vlahov D. The effectiveness of needle exchange programs: a review of the science and policy. AIDScience. 2001;1:32. [Google Scholar]
  • 64.Larney S, Peacock A, Leung J, Colledge S, Hickman M, Vickerman P, Grebely J, Dumchev KV, Griffiths P, Hines L, Cunningham EB, Mattick RP, Lynskey M, Marsden J, Strang J, Degenhardt L. Global, regional, and country-level coverage of interventions to prevent and manage HIV and hepatitis C among people who inject drugs: a systematic review. Lancet Glob Health. 2017;5(12):e1208–e1220. doi: 10.1016/S2214-109X(17)30373-X. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Due to the sensitivity of information related to substance use and treatment, the dataset will only be available upon request and with proper data use agreements in place. All materials developed for the study are available to be shared upon request.


Articles from BMC Public Health are provided here courtesy of BMC

RESOURCES