Skip to main content
BMJ Open Access logoLink to BMJ Open Access
. 2020 Jan 9;74(4):369–376. doi: 10.1136/jech-2019-212915

Individual and county-level variation in outcomes following non-fatal opioid-involved overdose

Evan Marie Lowder 1,, Joseph Amlung 2, Bradley R Ray 3
PMCID: PMC7079264  PMID: 31919146

Abstract

Background

A lack of large-scale, individually linked data often has impeded efforts to disentangle individual-level variability in outcomes from area-level variability in studies of many diseases and conditions. This study investigated individual and county-level variability in outcomes following non-fatal overdose in a state-wide cohort of opioid overdose patients.

Methods

Participants were 24 031 patients treated by emergency medical services or an emergency department for opioid-involved overdose in Indiana between 2014 and 2017. Outcomes included repeat non-fatal overdose, fatal overdose and death. County-level predictors included sociodemographic, socioeconomic and treatment availability indicators. Individual-level predictors included age, race, sex and repeat non-fatal opioid-involved overdose. Multilevel models examined outcomes following non-fatal overdose as a function of patient and county characteristics.

Results

10.9% (n=2612) of patients had a repeat non-fatal overdose, 2.4% (n=580) died of drug overdose and 9.2% (n=2217) died overall. Patients with a repeat overdose were over three times more likely to die of drug-related causes (OR=3.68, 99.9% CI 2.62 to 5.17, p<0.001). County-level effects were limited primarily to treatment availability indicators. Higher rates of buprenorphine treatment providers were associated with lower rates of mortality (OR=0.82, 95% CI 0.68 to 0.97, p=0.024), but the opposite trend was found for naltrexone treatment providers (OR=1.20, 95% CI 1.03 to 1.39, p=0.021). Cross-level interactions showed higher rates of Black deaths relative to White deaths in counties with high rates of naltrexone providers (OR=1.73, 95% CI 1.09 to 2.73, p=0.019).

Conclusion

Although patient-level differences account for most variability in opioid-related outcomes, treatment availability may contribute to county-level differences, necessitating multifaceted approaches for the treatment and prevention of opioid abuse.

Keywords: epidemiology, geography, mortality, multilevel modelling, substance abuse

Introduction

The USA is experiencing an overdose epidemic, driven by rising opioid-involved deaths.1 2 Originally attributed to overprescribing,3 the growing lethality of this epidemic is now attributed to illicit opioids, mainly fentanyl, with rapidly rising deaths among racial and ethnic minorities.2 4 5 The widespread nature of this epidemic has prompted investigation into sources of variability in overdose rates, especially geographic variation. Beyond state-level variation,6 7 regional and county-level differences in overdose rates have been documented.8–12 Higher rates of overdose deaths, especially opioid-involved deaths, have been linked to locales with greater proportions of residents who are White, female and aged 35–55,11 13 14 as well as higher rates of economic and social disadvantage.10 14

Despite growing research on geographic determinants of overdose outcomes, several limitations should be noted. Primarily, reliance on geographic-level data without accounting for individual-level variability has been criticised as an ecological fallacy,15 whereby inferences about individual behaviour are deduced incorrectly from local trends. Relatedly, the lack of large-scale, individually linked data has limited investigation into whether geographic variation in outcomes reflects individual-level differences. Yet, there is emerging evidence of racial disparities in fatal overdose outcomes.2 4 Disparities in access to education, housing, healthcare, employment and financial resources manifest from structural inequalities, and researchers have used community-level indicators of these characteristics to examine disparities in health outcomes,16 suggesting these indicators may inform individual-level disparities in drug overdose trends. Finally, limited availability of patient-level data has restricted investigation into non-fatal overdose outcomes. However, research on the course of opioid abuse shows fewer than 30% of users achieve abstinence over time.17 And, although opioid users are at heightened risk of death relative to the general population,17 only one-fifth die of drug-related causes.18 These trends have prompted investigation into the epidemiology of non-fatal overdose to inform intervention strategies prior to fatal outcomes.19 20

Government-led data linkage initiatives may increase the accessibility of individually linked data for the research community and the public visibility of individual trends in opioid outcomes. However, we are aware of only a few efforts to construct large and individually linked data sets to address this epidemic.19–21 British Columbia, for example, has established a province-level overdose cohort of fatal and non-fatal overdose patients to track antecedents of overdose events.20 The present study leveraged data from the Indiana Management Performance Hub (MPH), a state agency tasked with coordinating data linkage to inform policy, to investigate individual and county-level predictors of overdose-related outcomes in a state-wide cohort of non-fatal overdose patients from 2014 through 2017 (n=24 031). In addition to examining county-level predictors of opioid-related outcomes drawn from past studies,8 10 14 22–25 we examine treatment-related predictors hypothesised to explain county-level variability in opioid outcomes.26 Given growing evidence of racial disparities in overdose outcomes, our secondary aim was to examine the extent to which county-level trends in opioid-related outcomes were moderated by individual race.

Methods

Sample

We analysed records from a state-wide sample of 24 031 patients in Indiana aged 15 and older who had an emergency encounter for a suspected opioid overdose and survived. Patients were mainly White (n=22 399, 93.2%) versus Black (n=1632, 6.8%) and two-thirds male (n=14 151, 58.9%). Patients were primarily aged 15–24 (n=3836, 16.0%), 25–34 (n=7244, 30.1%), 35–44 (n=4303, 17.9%) and 45–54 (n=3264, 13.6%). Fewer participants were aged 55–64 (n=2581, 10.7%), 65–74 (n=1368, 5.7%), 75–84 (n=867, 3.6%) or 85 plus (n=568, 2.4%).

Procedure

From MPH we received deidentified, individual-level population data on all emergency medicine encounters in Indiana between 1 January 2014 and 31 December 2017. MPH partners with other agencies, including public health, behavioural health and public safety, to integrate administrative data sources and inform data-driven policymaking. MPH records were collated from three separate data sources. Emergency medical services (EMS) records were sourced from the Indiana Department of Homeland Security (IDHS). Per Section 836 of the Indiana Administrative Code 1-1-5, EMS providers are required to submit records from the National Emergency Medical Service Information System to IDHS. Emergency department (ED) records were sourced from the Indiana State Department of Health (ISDH). EDs are required to report syndromic surveillance data to ISDH, per Section 410 of the Indiana Administrative Code 1-2.4. Finally, vital records were sourced from ISDH for all deaths in Indiana, per Title 16 of the Indiana Code Article 37 Chapter 1-3.1. Individual demographics were collated from event records. Conflicting records were reconciled using the most recent non-null value. If multiple events happened on the same day, preference was given in the following order: death record, arrest record, ED visit, prescription dispensation and EMS run. Suspected opioid-involved overdose encounters with EMS were indicated by naloxone administration. ED visits involving an opioid overdose were determined from patient chief complaints and discharge diagnosis codes (International Classification of Diseases-Tenth Revision-Clinical Modification (ICD-10-CM), ICD-9-CM or Systematized Nomenclature of Medicine-Clinical Terms). The Indiana University Institutional Review Board determined this study to be exempt.

We assigned patients to Indiana counties via zip codes based on most probable county membership. Because we modelled multiple events that may have generated multiple zip codes for patients, we used residential location instead of place of injury to assign patients to counties. Of 683 zip codes, 676 were completely or primarily (ie, >50% of residents) located in one county. Only 7 (1.2%) zip codes were assigned to counties where <50% of zip code residents resided. Overall, the data included a census of 14 064 623 emergency medical events of which 35 466 involved a suspected opioid-related overdose. Duplicate EMS and ED events (n=2289) where patients received services on the same day were consolidated into one record. In total, 29 102 unique patients had one or more overdoses over the study period. Consistent with study aims, we removed 1187 cases where patients were identified as a race other than Black or White, 164 cases where the patient was under age 15 and 1750 cases where the zip code was outside of Indiana or was unknown. Of 26 001 remaining patients, 814 had missing demographic information. Finally, 1152 patients died within 1 day of the first overdose event, and an additional four were excluded for other reasons. The final sample included 24 031 patients who had a suspected opioid-involved overdose and survived.

Variables

Individual-level predictors included race (Black, White), sex (female, male), age and time at risk (days). Age categories were dummy coded per the Centers for Disease Control and Prevention age groups for mortality data (ie, 25–34, 35–44, 45–54, 55–64, 65–74, 75–84, 85 plus) with 15–24 as the reference category. Time at risk was operationalised as the number of days from the initial non-fatal overdose event for each patient to the end of the study period (31 December 2017) or the date of death if the patient died during the study period. Time at risk was included as a conditional effect in non-survival models and the outcome of interest in survival models. Repeat non-fatal opioid-involved overdose (yes, no) was included in models of any death or any drug-related death.

County-level predictors were selected if they were included in two or more investigations of geographic-level variability in drug overdose-related outcomes, primarily mortality.8 10 14 22 25 27 28 Median family income was highly collinear with racial composition (ie, percentage Black), r(90)=0.89, p<0.001, and excluded as a covariate. We included gender (ie, proportion male) due to its inclusion in other investigations of related outcomes.24 29 Finally, we examined three treatment-related predictors hypothesised to relate to geographic variability in opioid outcomes26: rate of halfway house providers, rate of buprenorphine providers and rate of naltrexone providers. See table 1 for description of data sources. When possible, county-level variables were coded based on 2014 estimates, representing the start of the study period. With the exception of rate of opioid prescription pills dispensed (rate per 100 000), rates were calculated as the rate per 10 000 residents based on 2014 5-year population estimates.30

Table 1.

Measurement and data source for county-level variables

Variable Measurement Source Year
Rural/urban Binary US Department of Agriculture, Office of Rural Health Policy 2010
Percentage Black Continuous US Census American Community Survey 2014
Percentage Hispanic Continuous US Census American Community Survey 2014
Percentage over 65 Continuous US Census American Community Survey 2014
Percentage male Continuous US Census American Community Survey 2014
Poverty rate Continuous US Census American Community Survey 2014
Percentage no high school diploma Continuous US Census American Community Survey 2014
Unemployment rate Continuous US Census American Community Survey 2014
Active medical doctor rate Continuous Health Resources and Services Administration 2014
Opioid pills dispensed rate Continuous Epidemiology Resource Center, Indiana State Department of Health 2014
Halfway house provider rate Continuous National Directory of Drug and Alcohol Abuse Treatment Programs 2014
Buprenorphine provider rate Continuous National Directory of Drug and Alcohol Abuse Treatment Programs 2014
Naltrexone provider rate Continuous National Directory of Drug and Alcohol Abuse Treatment Programs 2014

Outcome variables were dichotomous (yes, no) and included any repeat non-fatal opioid-involved overdose, any death and any drug-related death occurring during the study period. Drug-related deaths were coded based on ICD-10 codes from vital records indicating an underlying cause of death (X41−42, X44, X47, X60−62, X64, X67, Y12, Y14).

Analytical approach

We conducted descriptive statistics on study outcomes overall and by race. Additionally, we computed crude mortality rate (CMR) and standardised mortality rate (SMR) overall and by repeat non-fatal overdose during the study period. SMRs were calculated by estimating the probability of death for each patient based on the length of follow-up period and 2014 state-wide mortality estimates by age, race and sex.31 Resulting probabilities were summed to compute a ratio of observed deaths to expected deaths.

Multilevel models examined outcomes following non-fatal overdose. First, we conducted mixed models using PROC GLIMMIX in SAS V.9.4 software. Unconditional models were conducted to establish significant variability at each level of analysis.32 Continuous level 2 variables were standardised (M=0, SD=1) to allow for within-model comparison of level 2 effects. We initially conducted multivariable main effects models with level 1 and level 2 predictors as conditional effects. Subsequently, we tested cross-level interactions for level 2 indicators of treatment availability (ie, naltrexone treatment provider, buprenorphine treatment provider and halfway house provider rates) with race while controlling for level 1 and level 2 predictors. All patients were included in models predicting likelihood of a drug-related death or any death, and all models controlled for time at risk.

Second, to account for the variable follow-up period length and right-censored nature of study data, we conducted multilevel survival models in Stata V.14 using the mestreg command and specifying a Weibull distribution. For these analyses, we examined outcomes 1 year following the initial non-fatal overdose in a modified sample of 16 417 patients who had 1 year of follow-up data available. County-level differences in outcomes were adjusted by including a random effect for county. Level 1 predictors were included as conditional effects.

Due to the large sample size at level 1, and the potential for type 1 error, we used a p<0.001 criterion for interpreting level 1 effects. For level 2 effects and any effect involving level 2 variable, we employed a p<0.05 criterion. Where relevant, we report estimated marginal rates and associated 95% and 99.9% CIs.

Results

Descriptive

Patients were at risk for an average of 573.18 days (SD=387.76, range: 0–1460). Survival outcomes overall and by race are presented in table 2. Overall, 10.9% of patients (n=2612) had a repeat non-fatal opioid overdose and 10.3% (n=270) of those died over the study period. Most patients with a repeat non-fatal overdose experienced one event (n=1894, 72.5%). Overall, 9.2% of patients (n=2217) died, primarily of non-drug-related causes (n=1637, 73.8%). CMRs were 5.87 (95% CI 5.63 to 6.11) per 100 person-years for patients overall, 5.76 (95% CI 5.50 to 6.02) for patients without a repeat non-fatal overdose and 6.66 (95% CI 5.94 to 7.38) for patients with a repeat non-fatal overdose. SMRs were 7.26 (95% CI 6.96 to 7.57) for patients overall, 6.59 (95% CI 6.29 to 6.89) for patients without a repeat non-fatal overdose and 17.57 (95% CI 15.73 to 19.58) for patients with a repeat non-fatal overdose.

Table 2.

Descriptive statistics and bivariable comparison of study period survival outcomes by race

Group Total
n=24 031
Survived
n=21 814
Died
n=2217
Comparison
n (%) No repeat non-fatal OD Repeat non-fatal OD Drug related Non-drug related
n (%) n (%) n (%) n (%) χ2 (df) P value Φ
Black 1632 (6.8) 1369 (83.9) 127 (7.8) 28 (1.7) 108 (6.6) 12.32 (3) 0.006 0.02
White 22 399 (93.2) 18 103 (80.8) 2215 (9.9) 552 (2.5) 1529 (6.8)

OD, overdose.

Multilevel models

Unconditional models showed significant variability at both levels of analysis for all outcomes, all p<0.001. County-level intraclass correlation coefficient estimates suggested county-level differences explained 7.5% of variability in repeat non-fatal opioid-involved overdose, 11.4% of variability in likelihood of any death and 9.6% in likelihood of drug-involved death. Main effects models are presented in table 3. Significant individual-level predictors of any repeat non-fatal opioid overdose included sex (p<0.001), with men at higher risk (9.4%, 99.9% CI 6.6% to 13.2%) relative to women (8.2%, 99.9% CI 5.7% to 11.7%), and age. Older age groups showed lower likelihood of repeat non-fatal overdose relative to 15–24 year-olds. At the county level, higher rates of halfway house providers were associated with higher rates of repeat non-fatal overdose.

Table 3.

Multilevel models of patient and county-level main effects predicting overdose outcomes

Conditional effects B (SE) Repeat non-fatal overdose
n=24 031
Drug-related death
n=23 463
Any death
n=24 031
OR CI P value B (SE) OR CI P value B (SE) OR CI P value
Between-patient (L1)
 Race (White) −0.30 (0.09) 0.74 (0.54 to 1.00) 0.001 −0.37 (0.20) 0.69 (0.36 to 1.34) 0.066 −0.21 (0.12) 0.81 (0.55 to 1.19) 0.072
 Sex (male) −0.15 (0.04) 0.86 (0.75 to 1.00) <0.001 −0.14 (0.09) 0.86 (0.64 to 1.16) 0.104 −0.09 (0.06) 0.92 (0.76 to 1.11) 0.128
 25–34 (15–24) 0.01 (0.06) 1.01 (0.84 to 1.22) 0.831 0.18 (0.13) 1.20 (0.79 to 1.83) 0.149 0.24 (0.12) 1.27 (0.84 to 1.90) 0.054
 35–44 (15–24) −0.28 (0.07) 0.75 (0.60 to 0.94) <0.001 −0.002 (0.14) 1.00 (0.62 to 1.60) 0.989 0.40 (0.13) 1.49 (0.97 to 2.29) 0.002
 45–54 (15–24) −0.51 (0.08) 0.60 (0.46 to 0.77) <0.001 0.14 (0.15) 1.15 (0.70 to 1.91) 0.357 1.28 (0.13) 3.62 (2.39 to 5.47) <0.001
 55–64 (15–24) −0.56 (0.09) 0.60 (0.43 to 0.76) <0.001 −0.54 (0.19) 0.58 (0.31 to 1.10) 0.005 1.66 (0.12) 5.24 (3.47 to 7.92) <0.001
 65–74 (15–24) −1.30 (0.15) 0.27 (0.17 to 0.44) <0.001 −2.94 (0.71) 0.05 (<0.01 to 0.54) <0.001 2.15 (0.13) 8.62 (5.54 to 13.41) <0.001
 75–84 (15–24) −1.55 (0.21) 0.21 (0.11 to 0.42) <0.001 −2.23 (0.58) 0.11 (0.02 to 0.73) <0.001 2.64 (0.14) 13.97 (8.72 to 22.37) <0.001
 85 plus (15–24) −2.13 (0.34) 0.12 (0.04 to 0.36) <0.001 3.08 (0.16) 21.69 (12.97 to 36.26) <0.001
 Time at risk <0.01 (<0.01) 1.00 (1.00 to 1.00) <0.001 −0.003 (<0.001) 1.00 (1.00 to 1.00) <0.001 −0.003 (<0.01) 1.00 (1.00 to 1.00) <0.001
 Repeat non-fatal overdose (no) 1.30 (0.10) 3.68 (2.62 to 5.17) <0.001 1.03 (0.09) 2.81 (2.11 to 3.73) <0.001
Between-county (L2)
 Opioid prescribing rate −0.01 (0.08) 0.99 (0.84 to 1.16) 0.860 0.08 (0.09) 1.08 (0.91 to 1.30) 0.375 −0.08 (0.08) 0.92 (0.79 to 1.09) 0.338
 Medical doctor rate −0.07 (0.09) 0.93 (0.77 to 1.12) 0.467 −0.05 (0.11) 0.95 (0.77 to 1.17) 0.626 −0.05 (0.09) 0.95 (0.79 to 1.14) 0.593
 Rural (urban) 0.02 (0.18) 1.02 (0.72 to 1.45) 0.919 0.21 (0.22) 1.24 (0.80 to 1.91) 0.332 0.14 (0.17) 1.15 (0.82 to 1.61) 0.415
 Percentage Black 0.07 (0.09) 1.06 (0.88 to 1.27) 0.549 0.10 (0.10) 1.11 (0.91 to 1.35) 0.292 −0.03 (0.09) 0.98 (0.82 to 1.16) 0.790
 Percentage Hispanic −0.06 (0.09) 0.94 (0.79 to 1.12) 0.486 −0.10 (0.10) 0.91 (0.74 to 1.11) 0.343 −0.01 (0.08) 0.99 (0.84 to 1.17) 0.790
 Percentage male −0.10 (0.08) 0.90 (0.77 to 1.06) 0.207 −0.07 (0.10) 0.94 (0.77 to 1.14) 0.519 −0.05 (0.08) 0.95 (0.82 to 1.11) 0.538
 Percentage over 65 −0.03 (0.10) 0.97 (0.80 to 1.17) 0.735 −0.03 (0.11) 0.97 (0.77 to 1.21) 0.758 0.08 (0.09) 1.09 (0.90 to 1.31) 0.375
 Poverty rate −0.16 (0.10) 0.86 (0.71 to 1.03) 0.108 −0.27 (0.11) 0.76 (0.62 to 0.95) 0.016 0.08 (0.09) 1.09 (0.91 to 1.30) 0.360
 Percentage < high school education −0.01 (0.09) 0.99 (0.83 to 1.18) 0.918 −0.09 (0.11) 0.91 (0.72 to 1.14) 0.403 0.11 (0.08) 1.12 (0.95 to 1.32) 0.168
 Unemployment 0.15 (0.11) 1.16 (0.93 to 1.44) 0.175 0.19 (0.13) 1.21 (0.93 to 1.58) 0.159 −0.17 (0.10) 0.84 (0.68 to 1.03) 0.092
 Halfway house provider rate 0.17 (0.08) 1.18 (1.01 to 1.38) 0.036 0.25 (0.08) 1.28 (1.10 to 1.49) 0.002 0.21 (0.07) 1.23 (1.06 to 1.42) 0.006
 Buprenorphine provider rate −0.03 (0.09) 0.97 (0.81 to 1.16) 0.708 −0.18 (0.10) 0.83 (0.68 to 1.02) 0.077 −0.20 (0.09) 0.82 (0.68 to 0.97) 0.024
 Naltrexone provider rate 0.07 (0.08) 1.07 (0.91 to 1.26) 0.382 0.25 (0.09) 1.28 (1.07 to 1.54) 0.009 0.18 (0.08) 1.20 (1.03 to 1.39) 0.021
Random effects
 Between-county residual variability 0.30 (0.06) <0.001 0.20 (0.08) 0.007 0.25 (0.06) <0.001
 Between-patient residual variability 0.97 (0.01) <0.001 0.97 (0.01) <0.001 1.16 (0.01) <0.001

CI refers to 99.9% confidence interval for L1 effects and 95% confidence interval for L2 effects. To facilitate cross-variable comparison, L2 coefficients are standardised. For categorical variables, reference categories are listed in parentheses. For fatal overdose, adults aged 85 plus were removed from final model due to no instances of fatal overdose in that age group

L1, level 1; L2, level 2.

As shown in table 3, for drug-related death, significant effects included older age (65–84) and repeat non-fatal overdose during the study period. Patients with a repeat non-fatal overdose were three times more likely to die of fatal overdose (3.2%, 99.9% CI 2.0% to 5.1%) relative to patients without a repeat non-fatal overdose (0.9%, 99.9% CI 0.6% to 1.4%). At the county level, higher poverty rates were associated with lower rates of fatal overdose. Rates of halfway house and naltrexone treatment providers were positively associated fatal overdose.

Significant individual-level predictors of any death were limited primarily to age variables (see table 3). However, patients with a repeat non-fatal overdose were at greater likelihood of death overall (8.6%, 99.9% CI 5.8% to 12.8%) compared with patients without a repeat overdose (3.3%, 99.9% CI 2.2% to 4.7%), p<0.001. At the county level, higher rates of halfway house and naltrexone treatment providers were associated with higher rates of death while higher rates of buprenorphine treatment providers were negatively associated with death.

Cross-level interactions

Table 4 presents multivariable models with cross-level interactions of county-level treatment availability by race. Controlling for other conditional effects, there were no significant cross-level interactions in the prediction of repeat non-fatal overdose or drug-related death (all p>0.087). However, for any death, the rate of naltrexone treatment providers showed a significant interaction with race (p=0.019). Decomposition of this interaction at +1/–1 SDs suggested Black patients had higher rates of death (6.4%, 95% CI 3.6% to 11.1%) in counties with higher-than-average naltrexone treatment provider rates versus lower-than-average naltrexone treatment provider rates (1.7%, 95% CI 0.9% to 2.7%). This trend was less apparent for White patients, who had similar rates of any death in counties with higher-than-average (4.4%, 95% CI 3.4% to 5.7%) and lower-than-average (3.2%, 95% CI 2.3% to 4.7%) naltrexone treatment provider rates.

Table 4.

Multilevel model of main effects and cross-level interactions predicting overdose outcomes

Conditional effects Repeat non-fatal overdose
n=24 031
Drug-related death
n=23 463
Any death
n=24 031
B (SE) OR CI P value B (SE) OR CI P value B (SE) OR CI P value
Between-patient (L1)
 Race (White) −0.46 (0.14) 0.68 (0.49 to 0.96) <0.001 −0.31 (0.27) 0.73 (0.30 to 1.79) 0.255 −0.12 (0.15) 0.81 (0.54 to 1.22) 0.432
 Sex (male) −0.15 (0.04) 0.86 (0.75 to 1.00) <0.001 −0.15 (0.09) 0.86 (0.64 to 1.16) 0.102 −0.09 (0.06) 0.92 (0.76 to 1.11) 0.133
 25–34 (15–24) 0.01 (0.06) 1.01 (0.84 to 1.22) 0.835 0.18 (0.13) 1.20 (0.79 to 1.83) 0.148 0.24 (0.12) 1.27 (0.85 to 1.91) 0.051
 35–44 (15–24) −0.28 (0.07) 0.75 (0.60 to 0.94) <0.001 −0.001 (0.14) 1.00 (0.62 to 1.60) 0.992 0.40 (0.13) 1.50 (0.97 to 2.31) 0.002
 45–54 (15–24) −0.52 (0.08) 0.60 (0.46 to 0.77) <0.001 0.14 (0.15) 1.15 (0.70 to 1.91) 0.357 1.29 (0.13) 3.65 (2.41 to 5.53) <0.001
 55–64 (15–24) −0.56 (0.09) 0.57 (0.43 to 0.76) <0.001 −0.54 (0.19) 0.58 (0.31 to 1.10) 0.005 1.66 (0.12) 5.28 (3.94 to 7.99) <0.001
 65–74 (15–24) −1.29 (0.15) 0.27 (0.17 to 0.44) <0.001 −2.95 (0.71) 0.06 (<0.01 to 0.53) <0.001 2.16 (0.13) 8.69 (5.58 to 13.55) <0.001
 75–84 (15–24) −1.54 (0.21) 0.21 (0.11 to 0.42) <0.001 −2.23 (0.58) 0.11 (0.01 to 0.73) <0.001 2.64 (0.14) 14.08 (8.78 to 22.58) <0.001
 85 plus (15–24) −2.13 (0.34) 0.12 (0.04 to 0.36) <0.001 3.09 (0.16) 21.92 (13.09 to 36.69) <0.001
 Time at risk <0.01 (<0.01) 1.00 (1.00 to 1.00) <0.001 −0.003 (<0.01) 1.00 (1.00 to 1.00) <0.001 −0.004 (<0.01) 1.00 (1.00 to 1.00) <0.001
 Repeat non-fatal overdose (no) 1.30 (0.10) 3.68 (2.62 to 5.18) <0.001 1.04 (0.09) 2.82 (2.18 to 3.75) <0.001
Between-county (L2)
 Opioid prescribing rate −0.01 (0.08) 0.99 (0.84 to 1.16) 0.866 0.08 (0.09) 1.08 (0.91 to 1.29) 0.382 −0.08 (0.08) 0.92 (0.79 to 1.08) 0.339
 Medical doctor rate −0.07 (0.09) 0.93 (0.78 to 1.12) 0.469 −0.05 (0.11) 0.95 (0.77 to 1.17) 0.626 −0.05 (0.09) 0.95 (0.80 to 1.14) 0.587
 Rural (urban) 0.02 (0.18) 1.02 (0.72 to 1.44) 0.916 0.21 (0.22) 1.24 (0.81 to 1.90) 0.331 0.14 (0.17) 1.15 (0.82 to 1.60) 0.423
 Percentage Black 0.06 (0.09) 1.06 (0.88 to 1.27) 0.541 0.10 (0.10) 1.11 (0.91 to 1.34) 0.294 −0.02 (0.09) 0.98 (0.82 to 1.16) 0.804
 Percentage Hispanic −0.06 (0.09) 0.94 (0.80 to 1.11) 0.492 −0.10 (0.10) 0.91 (0.74 to 1.11) 0.336 −0.005 (0.08) 0.99 (0.85 to 1.17) 0.953
 Percentage male −0.10 (0.08) 0.90 (0.77 to 1.06) 0.207 −0.06 (0.10) 0.94 (0.77 to 1.14) 0.522 −0.05 (0.08) 0.95 (0.82 to 1.11) 0.521
 Percentage over 65 −0.03 (0.10) 0.97 (0.80 to 1.17) 0.732 −0.03 (0.11) 0.97 (0.77 to 1.20) 0.757 0.08 (0.09) 1.09 (0.91 to 1.30) 0.371
 Poverty rate −0.16 (0.10) 0.86 (0.71 to 1.03) 0.108 −0.27 (0.11) 0.76 (0.62 to 0.95) 0.016 0.08 (0.09) 1.09 (0.91 to 1.30) 0.345
 Percentage < high school education −0.01 (0.09) 0.99 (0.84 to 1.17) 0.913 −0.09 (0.11) 0.91 (0.73 to 1.14) 0.404 0.11 (0.08) 1.12 (0.96 to 1.32) 0.159
 Unemployment 0.14 (0.11) 1.16 (0.94 to 1.43) 0.176 0.19 (0.13) 1.21 (0.93 to 1.57) 0.157 −0.18 (0.10) 0.84 (0.68 to 1.02) 0.086
 Halfway house provider rate 0.16 (0.08) 1.17 (1.01 to 1.37) 0.044 0.25 (0.08) 1.29 (1.11 to 1.50) 0.001 0.20 (0.07) 1.23 (1.06 to 1.41) 0.007
 Buprenorphine provider rate −0.03 (0.09) 0.97 (0.81 to 1.15) 0.713 −0.19 (0.10) 0.83 (0.68 to 1.01) 0.073 −0.20 (0.09) 0.82 (0.69 to 0.97) 0.028
 Naltrexone provider rate 0.07 (0.08) 1.08 (0.92 to 1.26) 0.369 0.25 (0.09) 1.28 (1.07 to 1.54) 0.008 0.17 (0.08) 1.19 (1.02 to 1.38) 0.028
Cross-level interactions
 Halfway house provider rate × race (White) 0.15 (0.09) 1.16 (0.98 to 1.37) 0.087 −0.12 (0.18) 0.89 (0.62 to 1.27) 0.510 0.04 (0.10) 1.04 (0.85 to 1.27) 0.719
 Buprenorphine provider rate × race (White) −0.04 (0.18) 0.96 (0.68 to 1.36) 0.816 0.11 (0.34) 1.12 (0.57 to 2.19) 0.741 −0.17 (0.22) 0.84 (0.54 to 1.30) 0.436
 Naltrexone provider rate × race (White) −0.17 (0.27) 0.84 (0.49 to 1.44) 0.531 −0.08 (0.48) 0.92 (0.36 to 2.35) 0.868 0.54 (0.23) 1.73 (1.09 to 2.73) 0.019
Random effects
 Between-county residual variability 0.30 (0.06) <0.001 0.20 (0.82) 0.007 0.25 (0.07) <0.001
 Between-patient residual variability 0.97 (0.01) <0.001 0.97 (0.01) <0.001 1.16 (0.01) <0.001

CI refers to 99.9% confidence interval for L1 effects and 95% confidence interval for L2 effects. To facilitate cross-variable comparison, L2 coefficients are standardised. For categorical variables, reference categories are listed in parentheses. For fatal overdose, adults aged 85 plus were removed from the final model due to no instances of fatal overdose in that age group

L1, level 1; L2, level 2.

Multilevel survival models

Results of multilevel survival analyses are shown in table 5. As shown, after adjusting for county-level differences in outcomes, older age groups had a lower hazard of repeat non-fatal overdose but higher hazard of any death relative to patients aged 15–24 (all p<0.001). Women had a lower hazard of any death relative to men (HR=0.82, 95% CI 0.68 to 0.99, p<0.001). Having a repeat non-fatal overdose increased the hazard of a drug-related death by 3.02 (95% CI 1.94 to 4.69, p<0.001) and the hazard of any death by 1.69 (95% CI 1.24 to 2.30, p<0.001) relative to no repeat non-fatal overdose.

Table 5.

Multilevel survival models of overdose outcomes

Conditional effects Repeat non-fatal overdose
n=16 417
Drug-related death
n=15 998
Any death
n=16 417
HR (SE) CI P value HR (SE) CI P value HR (SE) CI P value
Between-patient (L1)
 Race (White) 0.76 (0.09) (0.51 to 1.14) 0.093 0.60 (0.18) (0.22 to 1.60) 0.085 0.88 (0.11) (0.58 to 1.34) 0.317
 Sex (male) 0.88 (0.05) (0.73 to 1.06) 0.021 0.84 (0.10) (0.56 to 1.25) 0.151 0.82 (0.05) (0.68 to 0.99) <0.001
 25–34 (15–24) 1.02 (0.07) (0.80 to 1.29) 0.801 1.75 (0.32) (0.96 to 3.17) 0.002 1.60 (0.25) (0.96 to 2.65) 0.002
 35–44 (15–24) 0.75 (0.06) (0.56 to 0.99) 0.001 1.54 (0.31) (0.79 to 3.01) 0.035 2.20 (0.35) (1.30 to 3.72) <0.001
 45–54 (15–24) 0.70 (0.07) (0.51 to 0.96) <0.001 1.73 (0.37) (0.86 to 3.47) 0.010 3.92 (0.60) (2.38 to 6.48) <0.001
 55–64 (15–24) 0.73 (0.08) (0.52 to 1.04) 0.003 1.24 (0.41) (0.54 to 2.82) 0.389 6.57 (0.97) (4.03 to 10.71) <0.001
 65–74 (15–24) 0.26 (0.05) (0.13 to 0.52) <0.001 0.10 (0.10) (<0.01 to 2.76) 0.022 11.00 (1.67) (6.67 to 18.14) <0.001
 75–84 (15–24) 0.24 (0.07) (0.09 to 0.60) <0.001 0.33 (0.24) (0.03 to 3.65) 0.132 16.30 (2.52) (9.79 to 27.13) <0.001
 85 plus (15–24) 0.09 (0.05) (0.01 to 0.58) <0.001 27.39 (4.28) (16.38 to 45.81) <0.001
 Repeat non-fatal overdose (no) 3.02 (0.40) (1.94 to 4.69) <0.001 1.69 (0.16) (1.24 to 2.30) <0.001
Random effects
 Between-county variability 0.23 (0.05) (0.10 to 0.51)

HR=hazard ratio produced by multilevel survival models. CI refers to 99.9% confidence interval for L1 effects. For categorical variables, reference categories are listed in parentheses. For fatal overdose, adults aged 85 plus were removed from the final model due to no instances of fatal overdose in that age group.

L1, level 1.

Discussion

We used a state-wide, individually linked data set to examine individual and county-level variability in fatal and non-fatal overdose outcomes over a 4-year period. Overall, our findings showed that few sociodemographic and socioeconomic county-level measures drawn from prior research were significant predictors of county-level variability in outcomes. Additionally, most variability was explained by individual-level differences. A small, but clinically significant, portion of non-fatal overdose patients (1 in 10) were at risk for repeat non-fatal overdose over a multiyear period; roughly 1 in 50 patients were at risk for fatal overdose. More broadly, patients with repeat non-fatal overdoses are at heightened risk of drug-related death and are unlikely to receive evidence-based treatment for opioid use disorder following non-fatal overdose,33 highlighting the critical role of emergency medical settings in the identification and treatment engagement of high-risk patients.34 35

County-level effects primarily reflected county-wide indicators of overdose prevalence and treatment availability. For example, counties with higher-than-average rates of naltrexone treatment providers had higher rates of fatal overdose and mortality. Although naltrexone use has grown more slowly than other medication-assisted therapies for substance use disorder, it remains popular in Indiana: 30% of counties had a naltrexone provider in 2014 (vs 20% with a buprenorphine provider). High rates of naltrexone use—especially Vivitrol, the extended-release injectable—have been attributed in part to aggressive marketing by pharmaceutical lobbyists.36 Evidence from clinical trials suggests it may be less effective than buprenorphine or methadone due to the extensive detoxification period required prior to initiation that serves as a barrier to treatment engagement.37 Our findings provide limited support for a beneficial effect of naltrexone availability on county-level mortality.

Further analysis showed that the effect of naltrexone treatment availability on mortality varied by race. Specifically, counties with greater availability of naltrexone providers had higher rates of Black deaths, suggesting that Black patients experienced barriers to treatment access or lack of alternative treatment options. Although there has been limited investigation of the use of naltrexone for opioid use disorder among Black patients, prior studies have found naltrexone is less efficacious for alcohol use in Black versus White patients.38 39 Relative to other medication-assisted therapies for opioid use disorder, prior studies have documented more resistance to the induction of extended-release naltrexone in community treatment settings, though not specifically among Black patients.37 However, barriers to naltrexone treatment initiation could explain disparate findings between naltrexone and buprenorphine, where findings were consistent with evidence on the effectiveness of buprenorphine on overdose outcomes, including mortality.40

Study limitations may guide future research on county-level distribution of opioid-related outcomes. Primarily, our investigation was retrospective and limited to available administrative records. Although we examined a multiyear period, this investigation was cross-sectional, not longitudinal. There may have been policy changes occurring in Indiana during this time that affected county-level practices. Efforts to integrate public data systems in response to this epidemic likely will increase the feasibility of conducting prospective, longitudinal and real-time data analysis to guide local policymaking. Additionally, we were unable to make causal inferences about the effects of county-level predictors on county-level variability in outcomes. Future longitudinal investigations may benefit from the inclusion of time-varying predictors to inform how opioid-related outcomes change as county characteristics vary from year to year. Finally, our investigation examined county-level, statistical variation in opioid-related outcomes. We did not conduct geospatial analysis nor adjust for spatial autocorrelation in our analyses. A growing number of studies have used these methodologies to model geographic variation in opioid outcomes, and further work in this area will be necessary as this epidemic evolves.

Despite limitations, our investigation is one of the first to examine individual and community-level predictors of opioid-related outcomes using patient-level data. Our findings overall suggest limited utility of sociodemographic and socioeconomic indicators in explaining between-county differences in opioid outcomes. Rather, our findings underscore the importance of individual characteristics in predicting opioid-related outcomes and point to treatment availability as a potential contributor to county-level differences in outcomes following non-fatal overdose.

What is already known on this subject.

  • A growing number of studies have shown evidence of geographic variability in opioid-related outcomes, including mortality.

  • Community characteristics such as relative social and economic disadvantage have been associated with higher rates of opioid-related mortality across jurisdictions.

  • Due to the limited availability of large-scale, patient-level data on opioid outcomes, few studies have examined whether county-level associations persist after accounting for patient-level variability in outcomes.

What this study adds.

  • Patient-level differences accounted for the vast majority of variability in opioid outcomes, with a repeat non-fatal overdose serving as the strongest risk factor for fatal overdose.

  • After accounting for patient-level differences, few community-level socioeconomic or sociodemographic characteristics drawn from prior research were associated with opioid-related outcomes. Instead, availability of community treatment providers emerged as the most consistent predictor of community-level differences in opioid outcomes.

  • Community-level strategies to address the opioid epidemic should focus on treatment access in high-risk communities.

Footnotes

Contributors: EML and BRR conceived the study. EML and JA cleaned and coded the study data. EML conducted the data analysis, with intellectual contribution from BRR. EML and BRR codrafted the manuscript. All authors approved the final manuscript. EML takes responsibility for its final content.

Funding: This work was funded through Indiana’s State Opioid Response Grant from the Substance Abuse and Mental Health Services Administration (TI081689-01).

Disclaimer: The contents are solely the responsibility of the authors and do not necessarily represent the official views of the State of Indiana or the Substance Abuse and Mental Health Services Administration. The funding source played no role in the design, conduct or reporting of this investigation.

Competing interests: EML and BRR contracted with Indiana’s Management Performance Hub to complete this work as part of the Indiana’s State Opioid Response Grant from the Substance Abuse and Mental Health Services Administration.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement: Data may be obtained from a third party and are not publicly available. Deidentified, patient-level data were provided to the researchers by the Indiana Management Performance Hub (MPH). MPH has an established process for external data requests. More information can be found at the following link: https://www.in.gov/mph/935.htm.

References

  • 1. Hedegaard H, Warner M, Miniño AM. Drug overdose deaths in the United States, 1999-2016. Hyattsville, MD: National Center for Health Statistics, 2017. https://www.cdc.gov/nchs/data/databriefs/db294.pdf [Google Scholar]
  • 2. Seth P, Scholl L, Rudd RA, et al. Overdose deaths involving opioids, cocaine, and psychostimulants — United States, 2015–2016. MMWR Morb Mortal Wkly Rep 2018;67:349–58. 10.15585/mmwr.mm6712a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Manchikanti L, Helm S, Fellows B, et al. Opioid epidemic in the United States. Pain Physician 2012;15:ES9–38. [PubMed] [Google Scholar]
  • 4. Alexander MJ, Kiang MV, Barbieri M. Trends in black and white opioid mortality in the United States, 1979–2015. Epidemiology 2018;29:707–15. 10.1097/EDE.0000000000000858 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Jalal H, Buchanich JM, Roberts MS, et al. Changing dynamics of the drug overdose epidemic in the United States from 1979 through 2016. Science 2018;361:eaau1184 10.1126/science.aau1184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Scholl L, Seth P, Kariisa M, et al. Drug and opioid-involved overdose deaths - United States, 2013-2017. Morbidity and Mortality Weekly Report 2019;67:1419–27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Ruhm CJ. Geographic variation in opioid and heroin involved drug poisoning mortality rates. Am J Prev Med 2017;53:745–53. 10.1016/j.amepre.2017.06.009 [DOI] [PubMed] [Google Scholar]
  • 8. Rossen LM, Khan D, Warner M. Trends and geographic patterns in Drug-Poisoning death rates in the U.S., 1999–2009. Am J Prev Med 2013;45:e19–25. 10.1016/j.amepre.2013.07.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Rossen LM, Khan D, Warner M. Hot spots in mortality from drug poisoning in the United States, 2007–2009. Health Place 2014;26:14–20. 10.1016/j.healthplace.2013.11.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Monnat SM. Factors associated with county-level differences in U.S. drug-related mortality rates. Am J Prev Med 2018;54:611–9. 10.1016/j.amepre.2018.01.040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Stewart K, Cao Y, Hsu MH, et al. Geospatial analysis of drug poisoning deaths involving heroin in the USA, 2000–2014. J Urban Health 2017;94:572–86. 10.1007/s11524-017-0177-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Haffajee RL, Lin LA, Bohnert ASB, et al. Characteristics of US counties with high opioid overdose mortality and low capacity to deliver medications for opioid use disorder. JAMA Netw Open 2019;2:e196373 10.1001/jamanetworkopen.2019.6373 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Balmert LC, Buchanich JM, Pringle JL, et al. Patterns and trends in accidental poisoning deaths: Pennsylvania’s experience 1979-2014. PLoS One 2016;11:e0151655 10.1371/journal.pone.0151655 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Hollingsworth A, Ruhm CJ, Simon K. Macroeconomic conditions and opioid abuse. J Health Econ 2017;56:222–33. 10.1016/j.jhealeco.2017.07.009 [DOI] [PubMed] [Google Scholar]
  • 15. Caputi TL, Sabet KA, et al. Population-level analyses cannot tell us anything about individual-level marijuana-opioid substitution. Am J Public Health 2018;108:e12–13. 10.2105/AJPH.2017.304253 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Phelan JC, Link BG, Tehranifar P. Social conditions as fundamental causes of health inequalities: theory, evidence, and policy implications. J Health Soc Behav 2010;51:S28–40. 10.1177/0022146510383498 [DOI] [PubMed] [Google Scholar]
  • 17. Hser Y-I, Evans E, Grella C, et al. Long-Term course of opioid addiction. Harv Rev Psychiatry 2015;23:76–89. 10.1097/HRP.0000000000000052 [DOI] [PubMed] [Google Scholar]
  • 18. Hser Y-I, Hoffman V, Grella CE, et al. A 33-year follow-up of narcotics addicts. Arch Gen Psychiatry 2001;58:503–8. 10.1001/archpsyc.58.5.503 [DOI] [PubMed] [Google Scholar]
  • 19. Chatterjee A, Larochelle MR, Xuan Z, et al. Non-Fatal opioid-related overdoses among adolescents in Massachusetts 2012–2014. Drug Alcohol Depend 2019;194:28–31. 10.1016/j.drugalcdep.2018.09.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. MacDougall L, Smolina K, Otterstatter M, et al. Development and characteristics of the provincial overdose cohort in British Columbia, Canada. PLoS One 2019;14:e0210129 10.1371/journal.pone.0210129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Campbell CI, Bahorik AL, VanVeldhuisen P, et al. Use of a prescription opioid registry to examine opioid misuse and overdose in an integrated health system. Prev Med 2018;110:31–7. 10.1016/j.ypmed.2018.01.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Dasgupta N, Funk MJ, Brownstein JS. Comparing unintentional opioid poisoning mortality in metropolitan and non-metropolitan counties, United States, 1999–2003 : Thomas YF, Richardson D, Cheung I, Geography and drug addiction. Springer Netherlands: Dordrecht, 2008: 175–92. [Google Scholar]
  • 23. Keyes KM, Cerdá M, Brady JE, et al. Understanding the rural–urban differences in nonmedical prescription opioid use and abuse in the United States. Am J Public Health 2014;104:e52–9. 10.2105/AJPH.2013.301709 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Wright ER, Kooreman HE, Greene MS, et al. The iatrogenic epidemic of prescription drug abuse: County-level determinants of opioid availability and abuse. Drug Alcohol Depend 2014;138:209–15. 10.1016/j.drugalcdep.2014.03.002 [DOI] [PubMed] [Google Scholar]
  • 25. Dwyer-Lindgren L, Bertozzi-Villa A, Stubbs RW, et al. Trends and patterns of geographic variation in mortality from substance use disorders and intentional injuries among US counties, 1980-2014. JAMA 2018;319:1013–23. 10.1001/jama.2018.0900 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Rigg KK, Monnat SM, Chavez MN. Opioid-related mortality in rural America: geographic heterogeneity and intervention strategies. International Journal of Drug Policy 2018;57:119–29. 10.1016/j.drugpo.2018.04.011 [DOI] [PubMed] [Google Scholar]
  • 27. King NB, Fraser V, Boikos C, et al. Determinants of increased Opioid-Related mortality in the United States and Canada, 1990–2013: a systematic review. Am J Public Health 2014;104:e32–42. 10.2105/AJPH.2014.301966 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Gomes T, Juurlink D, Moineddin R, et al. Geographical variation in opioid prescribing and opioid-related mortality in Ontario. Hcq 2011;14:22–4. 10.12927/hcq.2011.22153 [DOI] [PubMed] [Google Scholar]
  • 29. Cerdá M, Gaidus A, Keyes KM, et al. Prescription opioid poisoning across urban and rural areas: identifying vulnerable groups and geographic areas. Addiction 2017;112:103–12. 10.1111/add.13543 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. US Census Bureau 2013-2017 American community survey (ACS) 5-year estimates. Available: https://www.census.gov/programs-surveys/acs/technical-documentation/table-and-geography-changes/2017/5-year.html [Accessed 31 May 2019].
  • 31. Centers for Disease Control and Prevention,, National Center for Health Statistics . Compressed mortality file 1999-2016 on CDC wonder online database, 2016. Available: https://wonder.cdc.gov/cmf-icd10.html [Accessed 28 May 2019].
  • 32. Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysismethods. 2nd ed Newbury Park, CA: SAGE, 2002. [Google Scholar]
  • 33. Larochelle MR, Bernson D, Land T, et al. Medication for opioid use disorder after nonfatal opioid overdose and association with mortality. Ann Intern Med 2018;169:137–45. 10.7326/M17-3107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Kim B, Nolan S, Ti L. Addressing the prescription opioid crisis: potential for hospital-based interventions? Drug Alcohol Rev 2017;36:149–52. 10.1111/dar.12541 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Ray BR, Lowder EM, Kivisto AJ, et al. Ems naloxone administration as non-fatal opioid overdose surveillance: 6-year outcomes in Marion County, Indiana. Addiction 2018;113:2271–9. 10.1111/add.14426 [DOI] [PubMed] [Google Scholar]
  • 36. A drugmaker tries to cash in on the opioid epidemic, one state law at a time. all things considered, 2017. Available: https://www.npr.org/sections/health-shots/2017/06/12/523774660/a-drugmaker-tries-to-cash-in-on-the-opioid-epidemic-one-state-law-at-a-time [Accessed 8 May 2019].
  • 37. Lee JD, Nunes EV, Novo P, et al. Comparative effectiveness of extended-release naltrexone versus buprenorphine-naloxone for opioid relapse prevention (X:BOT): a multicentre, open-label, randomised controlled trial. The Lancet 2018;391:309–18. 10.1016/S0140-6736(17)32812-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Plebani JG, Oslin DW, Lynch KG. Examining naltrexone and alcohol effects in a minority population: results from an initial human laboratory study. The American Journal on Addictions 2011;20:330–6. 10.1111/j.1521-0391.2011.00138.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Ray LA, Oslin DW. Naltrexone for the treatment of alcohol dependence among African Americans: results from the combine study. Drug Alcohol Depend 2009;105:256–8. 10.1016/j.drugalcdep.2009.07.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Mattick RP, Breen C, Kimber J, et al. Buprenorphine maintenance versus placebo or methadone maintenance for opioid dependence. Cochrane Database of Systematic Reviews. [Google Scholar]

Articles from Journal of Epidemiology and Community Health are provided here courtesy of BMJ Publishing Group

RESOURCES