Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2019 May 1.
Published in final edited form as: J Acquir Immune Defic Syndr. 2018 May 1;78(1):43–53. doi: 10.1097/QAI.0000000000001634

Extended-Release Naltrexone Improves Viral Suppression among Incarcerated Persons Living with HIV with Opioid Use Disorders Transitioning to the Community: Results of a Double-Blind, Placebo-Controlled Randomized Trial

Sandra A Springer 1,2, Angela Di Paola 3, Marwan Azar 1, Russell Barbour 2, Breanne E Biondi 1, Maureen Desabrais 4, Thomas Lincoln 4, Daniel J Skiest 4, Frederick L Altice 1,2,5,6
PMCID: PMC5889326  NIHMSID: NIHMS935648  PMID: 29373393

Abstract

Objective

To determine if extended-release naltrexone (XR-NTX) would improve or maintain viral suppression (VS) among prisoners or jail detainees with HIV and opioid use disorders (OUD) transitioning to the community.

Design

A four-site, prospective randomized double-blind, placebo-controlled trial was conducted among prison and jail inmates with HIV and OUD transitioning to the community from September 2010 through March 2016.

Methods

Eligible participants (N=93) were randomized 2:1 to receive 6 monthly injections of XR-NTX (n=66) or placebo (n=27) starting at release and observed for 6 months. The primary outcome was the proportion that maintained or improved VS (<50 copies/mL) from baseline to 6 months.

Results

Participants allocated to XR-NTX significantly improved to VS (<50 copies/mL) from baseline (37.9%) to 6-months (60.6%) (p=0.002), while the placebo group did not (55.6% at baseline to 40.7% at 6-months p=0.294). There was, however, no statistical significant difference in VS levels at 6 months between XR-NTX (60.6%) vs. Placebo (40.7%) (p=0.087). After controlling for other factors, only allocation to XR-NTX (aOR=2.90; 95% CI=1.04–8.14, p=0.043) was associated with the primary outcome. Trajectories in VS from baseline to 6 months differed significantly (p=0.017) between treatment groups, and the differences in the discordant values were significantly different as well (p=0.041): the XR-NTX group was more likely than the placebo group to improve VS (30.3% vs 18.5%); maintain VS (30.3% vs. 27.3), and less likely to lose VS (7.6% vs. 33.3%) by 6 months.

Conclusion

XR-NTX improves or maintains VS after release to the community for incarcerated PLH with OUD.

Keywords: HIV, Viral Load, HIV-1 RNA, Opioid Use Disorder, Extended-Release Naltrexone, prisoners, jail, criminal justice system, randomized controlled trial

Introduction

To increase the likelihood of viral suppression (VS), International guidelines recommend directly administered antiretroviral therapy (DAART) for prisoners with HIV transitioning to the community, and in community settings, HIV patients with opioid use disorder (OUD) should be offered methadone or buprenorphine with or without DAART.1 Such guidelines have not been updated in recent years.

Both HIV and opioid use disorder (OUD) are highly prevalent among persons within the criminal justice system (CJS).25 Release to the community for people living with HIV (PLH) is associated with loss of HIV viral suppression (VS), despite high levels attained during the incarceration.3,4,6,7 Moreover, for released prisoners with OUD, relapse exceeds 85%, mostly within the first two weeks and is associated with overdose and death.810 Inadequately treated OUD interrupts HIV treatment adherence with resultant loss of VS.11,12

Three evidence-based medication treatments for OUD are available, including two opioid agonists (methadone and buprenorphine) and one opioid antagonist (injectable extended-release naltrexone: XR-NTX, Vivitrol®). Unlike opioid agonists, XR-NTX is not a controlled substance, does not require regulatory licensing for prescription, also treats alcohol use disorders, and is without diversion concerns.1319 In criminal justice involved persons with OUD, XR-NTX has been associated with decreased opioid use.20 Recent randomized controlled trials confirm its equivalence in treatment of OUD with buprenorphine in community settings.21,22 Despite data suggesting that buprenorphine maintains or improves VS in released prisoners with HIV,11,12 the use of XR-NTX has not been tested on HIV VS.

We therefore sought to examine in a multi-site study if treatment with XR-NTX would improve or maintain VS levels after release in prisoners and jail detainees with HIV and OUD using a double blind, placebo-controlled trial.

Methods

Study Design

The study protocol and detailed methods have previously been published,13 along with preliminary safety data,17 and early post-release retention data.16 This multi-site, double-blind, placebo-controlled trial was conducted between September 1, 2010 and March 31, 2016 and compared XR-NTX with placebo among incarcerated people living with HIV (PLH) with OUD transitioning to the community over a six-month period.

Ethical Oversight

All study procedures were reviewed and approved by the Institutional Review Boards (IRB) at all four study sites, the Office of Human Research Protections at the Department of Health and Human Services, and research committees at Hampden County Correctional Centers (HCCC) and the Connecticut Department of Correction (CT DOC). A Certificate of Confidentiality was obtained for additional participant protections. The study is registered at www.clinicaltrials.gov (NCT01246401).

Recruitment

Recruitment occurred between September 2010 and August 2015. Initial referrals were made by nursing and transitional care staff within prison or jail with confirmatory screening and informed consent by study personnel.

Study Eligibility Criteria

Inclusion criteria

1) HIV-seropositive; 2) returning to three sites in Connecticut (New Haven, Hartford, Waterbury) or Springfield, Massachusetts; 3) DSM-IV criteria for opioid dependence; 4) able to provide informed consent; 5) speaks English or Spanish; 6) age ≥18 years; 7) not receiving methadone or buprenorphine or involved in an antiretroviral treatment (ART) adherence trial in the previous 30 days; and 8) within 30 days of release from prison or jail.

Exclusion criteria

1) threatening behavior toward research staff or other participants; 2) other pending charges; 3) receiving opioid pain medications or expressing a need for them; 4) known hypersensitivity to naltrexone or its diluent components; and 5) study medication contraindications that included: a) aspartate aminotransferase (AST) or alanine aminotransferase (ALT) elevations (>5× upper limit of normal); b) evidence of Child Pugh Class C cirrhosis; or c) breastfeeding, pregnant or unwilling to use contraception for female participants.

Informed Consent Process and Enrollment

Study personnel completed informed consent procedures with eligible and interested individuals; consent was repeated immediately after release to prevent real or perceived coercion.

Randomization

Participants were then randomly allocated 2:1 to receive 380mg of XR-NTX or placebo (provided in-kind by Alkermes, Inc.), administered intramuscularly every 4 weeks for six months. A covariate adaptive stratified block randomization was performed2325 using the study site and whether ART was prescribed or not.

Study Measures

After enrollment, participants underwent baseline assessments, monthly follow-up interviews and laboratory assessments for six months13 using a computer-assisted survey instrument (CASI).26,27 Structured interviews included demographic information, housing and health care status, mental health co-morbidities (Mini International Neuropsychiatric Interview [M.I.N.I.]),28,29 depressive symptoms (Brief Symptom Inventiory-18),30 quality of life (12-item Short Form Health Survey (SF-12),31 Alcohol Use Disorder Identification Test (AUDIT),32 and daily opioid use reports using a structured Timeline Follow-back (TLFB).33,34 Biological measures included: monthly urine drug toxicology screens, urine pregnancy tests for female participants, and quarterly phlebotomy to assess HIV-1 RNA levels. Tolerability and adverse events were monitored monthly using the Systemic Assessment For Treatment Emergent Effects Intervention (SAFTEE),35 and also included liver function tests and injection site reaction assessments.

Study Procedures

Study injections were administered within one week before or on the day of release and then monthly for five additional months (N=6 potential injections). During injection procedures, all participants received a brief 15-minute medical management (MM) counseling intervention.36 Optional individual drug counseling sessions and 12-step group counseling meetings were available to all participants. Participants were compensated for contributing their time to the research activities and not for receiving study medication.

Sample Size and Power Calculations

We calculated an original sample size of 150 (XR-NTX=100 and placebo=50) needed to detect a statistically significant difference in the primary outcome at 6 months between the two groups. This incorporated a two-sided alpha=0.05, beta=0.20, and a compound symmetry true correlation structure of 0.5 (the most conservative, based on our results from earlier studies where our prison-release data suggested that 59% of HIV+ inmates leave prison with VS6,37). Calculations also included oversampling (2:1 randomization) those receiving XR-NTX due to potential adverse events.

Participant disposition

Of the 222 PLH referred to the study, 151 consented and 93 were included in the final analytical sample; 66 were randomized to receive XR-NTX and 27 to receive placebo. The CONSORT diagram is depicted in Figure 1.

Figure 1.

Figure 1

Study Enrollment Flow Chart.

Statistical Analysis

Baseline Characteristics

Baseline characteristics were compared between the two study treatment groups utilizing paired t-tests, Fisher’s Exact, ANOVA, and chi-squared to assess for differences using SPSS and R.

Missingness Analysis

Overall 14.1% of participants had missing HIV-1 RNA data at 6-months post-release. Using Little’s MCAR (“Missing Completely at Random”) test38 using the BaylorEdPsych package in R,39 we explored the structure of the missing data to determine if the data were MCAR and not related to the dependent or independent variables. The highly non-significant results (p=0.560) suggested that the missing data were not statistically related to the main outcome (VS), viral load (VL) at baseline, nor any of the variables used in the analysis, most importantly, treatment assignment or number of XR-NTX injections. High p-values for Little’s MCAR test suggest that further missingness inquiries using sensitivity analysis are not merited because the data were clearly neither Missing at Random nor Not Missing at Random.40,41 Consequently, we were able to maintain the most conservative standard Intention-to-Treat (ITT) assumption that missingness from participant attrition equals viral non-suppression (missing=failure). This is the standard analytic method for regulatory submission of HIV-1 RNA data to the U.S. Food and Drug Administration,42 which provides the most sensitive and conservative detection limits available and used previously in prospective trials of PLH where HIV-1 RNA is the outcome. We did, however, make adjustments such that if a participant had both VS confirmed at 3 months and 9 months (before or after the 6-month censor period of data analysis) then that data was considered in the 6-month missing outcome evaluation and not simply denoted as ‘failure’. Of note, there was no statistically significant difference in available VL data between treatment groups at 6 months (88.9% placebo, 84.9 % XR-NTX, p=0.597).

Outcome Variables

Primary Outcome: Intention-to-Treat (ITT) Analysis of Viral Suppression from Baseline to 6 Months

The original pre-determined primary outcome was VS defined as HIV-1 RNA<400 copies/mL after 6 months of observation, primarily because our prior studies of released HIV prisoners had a lower limit of VS at <400 copies/mL.6,13,37 After finalizing study protocols, standard clinical practice used more stringent VS cut-offs (<50 copies/mL) as the lower limit of detection. We therefore report findings using maximal VS (<50 copies/ml) as the primary outcome,43 however, VS<400 copies/mL is also reported. Using an ITT strategy, the primary outcomes involved a comparison of the changes in maximal VS levels (<50 copies/mL) from baseline to 6 months after release. Our hypothesis was that effective treatment of OUD would maintain VS for those already on ART, and for those not on it at the time of enrollment (either by preference while incarcerated due to confidentiality concerns), they might be more likely to initiate it.11,44 Consequently, the change in VS from baseline to 6 months best reflected how participants would do over time either with or without effective treatment of OUD. After dichotomizing VS as suppressed (<50 copies/mL) or not, changes in VS were assessed using Welch’s t-test using R statistical software,45 with p<0.05 as being statistically significant.

In addition, the principal outcome of VS required a further more nuanced analysis since 4 possible VS suppression trajectories were possible from baseline to 6 months: (1) maintained VS; (2) improved to VS; (3) lost VS from baseline to six months; and (4) remained detectable at baseline and six months. Using Pearson’s Chi-squared test, we compared the distribution of the placebo to the XR-NTX arms across these four possible outcomes. To further capture changes in VS from baseline to 6 months, we applied McNemer’s Chi-squared test using the exact2×24648 package in R to the discordant outcomes where VS status had changed.

The mean change in VL (copies/mL) was also analyzed between treatment arms comparing the baseline with 6-month time–points. The negative values for changes in the XR-NTX group precluded the usual log transformation, thus we used the original data and report the mean changes.

Multiple Logistic Regression Analysis of Predictors of Viral Suppression at 6 Months

After confirming that a statistically significant difference was found for changes in VS, we explored predictive variables guided by the literature,7,16 including treatment group assignment and the number of injections received to further explain independent predictors for maximal VS (<50 copies/ml). A backward stepwise model selection “step” algorithm in R then sequentially eliminated variables until we achieved models with the best goodness-of-fit using the Akaike information criterion (AIC), as they yielded the most parsimonious results.

Other Secondary Outcomes Statistical Analysis Methods

Opioid abstinence and time to relapse to opioid use

Daily opioid use was assessed for the 30 days prior to incarceration and monthly throughout the study follow-up period utilizing the TLFB.49 Variables generated from this tool included the number of consecutive days abstinent or time to first opioid use at the end of the 6-month intervention period. We performed a Kaplan-Meier test for time to first opioid use, or more specifically as an adjustment for the censoring of the end of the observation period at six months, using the study’s TLFB self-reported data and monthly urine toxicology screens. We considered the observations “reported days of consecutive abstinence in six months”. Those who dropped out of the study were most conservatively assumed to have resumed opioid use. The participants with missing data therefore reported no days of abstinence. Because previous studies have confirmed the effect of XR-NTX on opioid relapse and abstinence, this study was not powered to detect this outcome, but instead was intended for use as a planned “as treated” to complement the ITT analysis. We grouped participants into those (1) who had received three or more injections of XR-NTX (N=22 participants) and (2) those who received two or fewer XR-NTX injections or were in the placebo group (N=71) in the other group. Statistical significance was tested using the log rank test and Welch’s t-test for days of continuous reported abstinence.

Adverse Events

Chi-squared analyses were used to explore the differences in side effects between the treatment groups.

Results

Baseline Characteristics

There were no differences in baseline characteristics between treatment arms (Table 1). Participants were on average in their mid-40s, mostly men (81.7%), racial/ethnic minorities (85.7%), homeless or unstably housed (63.4%), prescribed ART (89.1%), co-infected with chronic Hepatitis C virus (83.5%), had prior pre-incarceration experience with methadone and/or buprenorphine (75.3%), and were incarcerated for a mean duration of 8.8 months. Central to the analysis, baseline VS levels at <400, <200 and <50 copies/mL were 64.5%, 58.1% and 43.0%, respectively, and not statistically significantly different. There were also no differences in mean baseline CD4 count (465 vs 581 cells/mL; p=0.088).

Table 1.

Baseline Characteristics

Variable XR-NTX
N=66 (%)
Placebo
N=27 (%)
Total
N=93 (%)
p Value
Gender
 Male 55 (83.3) 21 (77.8) 76 (81.7) 0.562
 Female 11 (16.7) 6 (22.2) 17 (18.3)

Ethnicity
 Black 17 (25.8) 6 (22.2) 23 (24.7) 0.806
 Hispanic 42 (63.3) 19 (70.4) 61 (65.6)
 White 7 (10.6) 2 (7.4) 9 (9.7)

Age in Years, Mean (SD) 46.6 (8.3) 43.9 (7.8) 45.8 (8.2) 0.147

Completed GED or High School 37 (56.1) 12 (44.4) 49 (52.7) 0.308

Referred from
 Prison 14 (21.2) 7 (25.7) 21 (22.6) 0.729
 Jail 49 (74.2) 18 (66.7) 67 (72.0)
 Community 3 (5.4) 2 (7.4) 5 (5.4)

Mean Incarceration (months; SD) 8.5 (10.0) 9.3 (12.0) 8.8 (10.5) 0.735

Study Site
 Greater New Haven 24 (36.4) 10 (37.0) 34 (36.6) 0.668
 Greater Hartford 32 (48.5) 11 (40.7) 43 (46.2)
 Greater Springfield 10 (15.2) 6 (22.2) 16 (17.2)

Housing status
 Stable 23 (34.8) 11 (40.7) 34 (36.6) 0.365
 Unstable 19 (28.8) 4 (14.8) 23 (24.7)
 Homeless 24 (36.4) 12 (44.4) 36 (38.7)

Chronic Hepatitis C (N=79) 46 (83.6) 20 (83.3) 66 (83.5) 1.000

Currently Prescribed ART 58 (89.2) 24 (88.9) 82 (89.1) 1.000

Prescribed ART Based Regimen (N=82)
 Protease Inhibitor (PIs) 26 (44.8) 5 (20.8) 31 (37.8) 0.105
 Non-Nucleoside Reverse
  Transcriptase Inhibitors (NNRTIs) 17 (29.3) 13 (54.2) 30 (36.6)
 Integrase Inhibitors 7 (12.1) 4 (16.7) 11 (13.4)
 Combination 8 (13.8) 2 (8.3) 10 (12.2)

HIV-RNA Viral Load (copies/mL) (N=93)
 < 400 42 (63.6) 18 (66.7) 60 (64.5) 0.784
 < 200 37 (56.1) 17 (63.0) 54 (58.1) 0.544
 < 50 25 (37.9) 15 (55.6) 40 (43.0) 0.129

HIV-RNA Viral Load (copies/mL)
 Mean (SD) 21,439 (85,004) 4,535 (13,238) 16,478 (72,054) 0.308
 Log10 Mean (SD) 2.47 (1.3) 2.18 (1.1) 2.38 (1.2) 0.313

Mean CD4 count (SD) 465.2 (273.8) 580.8 (336.8) 498.8 (296.3) 0.088

Mini International Neuropsychiatric Interview (M.I.N.I.)
 Bipolar Disorder 9 (14.8) 2 (8.3) 11 (12.9) 0.721
 Major Depressive Disorder 15 (24.6) 9 (37.5) 24 (28.2) 0.234
 PTSD 10 (16.4) 5 (20.0) 15 (17.4) 0.757
 Generalized Anxiety Disorder 9 (14.8) 4 (16.0) 13 (15.1) 1.000

Brief Symptom Index, Depression (N=89) 25 (38.5) 11 (45.8) 36 (40.4) 0.529

ASI Scores, Median (range)
 Drug 0.40(0.00–0.66) 0.46(0.16–0.78) 0.43(0.00–0.78) 0.173
 Alcohol 0.00(0.00–0.97) 0.00(0.00–0.65) 0.00(0.00–0.97) 0.242

Quality of Life, SF-12, Median (range)
 Physical 52.5(26.0–62.7) 50.8(23.5–59.7) 51.7(23.5–62.7) 0.441
 Mental 42.2(15.3–66.3) 42.7(17.9–59.8) 42.6(15.3–66.3) 0.950

Alcohol Use Severity (by AUDIT score)
 Abstinent or Low-Risk Drinking 42 (64.6) 23 (85.2) 65 (70.7) 0.097
 Hazardous Drinking 11 (16.9) 2 (7.4) 13 (14.1)
 Harmful Drinking 2 (3.1) 0 (0.0) 2 (2.2)
 Possible Dependence 10 (15.4) 2 (7.4) 12 (13.0)

Opioid Craving (scale of 0–10)
 Mean (SD) 3.2 (3.6) 3.5 (3.8) 3.3 (3.6) 0.700

Substance Use (years; SD)*
 Alcohol Mean 13.5 (15.2) 9.2 (11.6) 12.2 (14.3) 0.186
 Cannabis Mean 14.0 (14.3) 12.8 (12.5) 13.6 (13.7) 0.705
 Cocaine Mean 17.5 (11.4) 18.7 (8.6) 17.9 (10.6) 0.634
 Heroin Mean 20.1 (11.2) 18.4 (10.2) 19.6 (10.9) 0.491
 Other Opioids 2.8 (7.2) 3.2 (5.4) 2.9 (6.7) 0.818

Positive Urine Toxicology Result
 Opioids 8 (12.1) 3 (11.1) 11 (11.8) 0.968
 Cocaine 11 (16.7) 5 (18.5) 16 (17.3) 0.739

Substance Use Disorder via M.I.N.I.
 Alcohol Use Disorder 18 (29.5) 5 (20.0) 23 (26.7) 0.366
 Cannabis Use Disorder 16 (26.2) 6 (25.0) 22 (25.9) 0.907
 Cocaine Use Disorder 47 (77.0) 21 (87.5) 68 (80.0) 0.373

Previous Experience with MAT 51 (77.3) 19 (70.4) 70 (75.3) 0.484
 Methadone Lifetime 43 (84.3) 17 (89.5) 60 (85.7) 0.717
 Methadone past 30 days 16 (37.2) 5 (29.4) 21 (35.0) 0.568
 Buprenorphine Lifetime 34 (66.7) 11 (57.9) 45 (64.3) 0.496
 Buprenorphine past 30 days 14 (41.2) 6 (54.5) 20 (44.4) 0.500

Injections received
 0–2 44 (66.7) 18 (66.7) 62 (66.7) 0.91
 3–6 24 (36.4) 9 (33.3) 33 (35.5)

Cumulative injections received
 1 45 (68.2) 17 (63.0) 62 (66.7) 0.628
 2 28 (42.4) 10 (37.0) 38 (40.9) 0.631
 3 24 (36.4) 9 (33.3) 33 (35.5) 0.782
 4 15 (22.7) 7 (25.9) 22 (23.7) 0.742
 5 9 (13.6) 5 (18.5) 14 (15.1) 0.550
 6 10 (15.2) 4 (14.8) 14 (15.1) 0.967

LEGEND: Abbreviations: ART = antiretroviral therapy; ASI = Addiction Severity Index; AUDIT = Alcohol Use Disorders Identification Test; MAT = medication assisted therapy; Mini International Neuropsychiatric Interview = M.I.N.I.; PTSD = post-traumatic stress disorder; SD= standard deviation, SF-12 = Short Form 12;

HIV Treatment Retention

There were no statistically significant differences between the two groups at 6 months in the proportion of those: with HIV VL data (XR-NTX=84.9%, Placebo=88.9%; p=0.597); who completed 6-month study interviews (XR-NTX=49.5%, placebo=50.5%; p=0.822, see Figure 5); or who were retained for study injections (66.7% received 2 or fewer study injections and 35.5 % received 3–6 study injections; see Table 1).

Figure 5. Six month Study retention.

Figure 5

XR-NTX=extended-release naltrexone

Primary Outcome: Viral suppression at 6-Months

Compared to the placebo group that decreased VS levels over time (55.6% at baseline to 40.7% at 6 months, p=0.294), the XR-NTX group had a statistically significant improvement in the proportion who maintained or achieved VS at <50 copies/mL from baseline (37.9%) to 6 months (60.6%) (p=0.002) (Figure 2). A direct comparison of VS levels at 6 months between the two treatment groups, however, approached statistical significance (XR-NTX=60.6%, Placebo=40.7%; p=0.08). For higher VS levels (<400 copies/mL), there were no time differences in VS levels for the XR-NTX (63.6% at baseline to 68.2% at 6 months; p=0.47) or placebo (66.7% at baseline to 59.3% at 6 months; p=0.574). Similarly for this level of VS, the XR-NTX and placebo groups did not differ significantly at 6 months (68.2% vs 59.3%; p=0.43, respectively).

Figure 2.

Figure 2

Change in Viral Suppression (<50 copies/mL) from Baseline to 6 months

When comparing the distribution of the 4 possible outcomes (Figure 3): (1) the XR-NTX group was significantly more likely to improve to VS (<50 copies/mL) levels at 6 months compared to placebo (30.3% vs 18.5%): (2) maintain VS at 6 months (30.3% vs 27.3%); and (3) less likely to lose VS (7.6% vs 33.3%) at 6 months (Pearson’s Chi-Square p=0.017; McNemer’s Chi Square, p= 0.043). Additionally, when evaluating further the participants who had a (4) detectable VL at the time of release to 6 months, the XR-NTX group also statistically significantly reduced the mean VL by −6,515.7 copies/mL while the placebo group increased the mean VL by +9,081.4 copies/mL (p=0.031).

Figure 3.

Figure 3

Distribution of Viral Suppression (<50 copies/mL) Category by Treatment Group From Baseline to 6 Months

Pearson chi squared was evaluating difference in distribution of observations for the 4 categories between groups and was statistically significant (p=0.017). Discordant observation over time within groups and Between groups was evaluated with McNemar’s chi-square test, and was statistically significant (p=0.041)

Multivariate Analysis of Independent Predictors of Achieving Viral Suppression

When controlling for potential confounders (Table 2), assignment to the XR-NTX group remained significantly associated with the primary outcome. No other variables, including cocaine use disorder, homeless and unstably housed status, and number of injections received, were significant.

Table 2.

Multivariate Models Predictive of Viral Suppression at <50 copies/mL

Variables aOR (95% CI) p Value
(Intercept) 0.192 (0.052, 0.704) 0.129
Treatment Arm
 Placebo Referent
XR-NTX 2.902 (1.035, 8.137) 0.043
Cocaine Use Disorder 2.031(0.753, 5.482 0.162
Insure Housing 1.956 (0.740, 5.170) 0.207
Number of Injections:
 2 or less Referent
 3 or more 1.860 (0.710, 4.872) 0.207

AIC=118

Legend: Abbreviations: aOR = adjusted odds ratio; CI = 95% confidence interval; XR-NTX = extended-release naltrexone; AIC = Akaike Information Criterion; BOLD represents statistically significant.

Time to First Opioid Use

The ITT analysis revealed no statistically significant difference in time to first opioid use (continuous days of opioid abstinence) between treatment arms (XR-NTX mean=73.6 days, placebo mean=99.7 days; p=0.110) (Figure 4a). In the as-treated analysis (Figure 4b), those who received 3 or more XR-NTX injections had a statistically significantly longer time of continuous days of opioid abstinence (mean=136.4 vs 53.2 days; p=0.002) compared to those who received any number of placebo injections or 2 or fewer XR-NTX injections.

Figure 4.

Figure 4

Kaplan Meier Curve Days of Continuous Opioid Abstinence

4a. Intention to treat analysis; 4b. As-treated Analysis by Treatment Grouping.

Adverse Events

No serious Grade 3 or 4 hepatic events or any serious injection site or other adverse events occurred in either treatment group. The most common reported side effect (12%) was immediate injection site reaction (redness, soreness) and fatigue (7%), with no statistically significant differences between the groups (Table 3). The study did not evaluate non-fatal opioid overdoses. One participant in the XR-NTX group experienced a fatal opioid overdose 128 days after his last injection, but was determined not to be a study-related treatment serious adverse event by the Yale School of Medicine IRB, correctional system IRBs, Baystate Medical Center IRB, Alkermes Inc. review board, or by NIDA.

Table 3.

Adverse Events

Adverse Event XR-NTX Placebo Total Sample p Value
Transaminase level 5× Upper Limit of Normal
Aspartate aminotransferase (AST)
 Baseline; N=85 1% (1) 0% (0) 1% (1) 1.000
 Month 6; N=39 0% (0) 0% (0) 0% (0) N/A
Alanine transaminase (ALT)
 Baseline; N=86 1% (1) 0% (0) 1% (1) 1.000
 Month 6; N=39 7% (2) 0% (0) 5% (2) 1.000
Other Adverse events N=66 N=27 N=93
Skin and Soft Tissue Infection 3% (2) 1% (1) 3% (3) 1.000
Signs of Edema 3% (2) 4% (2) 2% (4) 0.577
Immediate Injection Reaction 15% (10) 4% (2) 13% (12) 0.498
Injection Site Reaction 3% (2) 0% (0) 2% (2) 1.000
Nausea 2% (1) 4% (1) 2% (2) 0.500
Vomiting 2% (1) 0% (0) 1% (1) 1.000
Diarrhea 5% (3) 0% (0) 3% (3) 0.554
Decreased Appetite 3% (2) 4% (1) 3% (3) 1.000
Increased Appetite 3% (2) 4% (1) 3% (3) 1.000
Headache 8% (5) 0% (0) 5% (5) 0.317
Dizziness 0% (0) 0% (0) 0% (0) N/A
Fatigue 9% (6) 4% (1) 8% (7) 0.669

Discussion

To our knowledge, this is the first randomized, placebo-controlled, double-blind trial that examined whether an evidence-based pharmacotherapy to treat OUD, XR=NTX, resulted in improved viral suppression levels in prisoners and jail detainees with HIV who were released from prison or jail. The key findings from this trial were that maximal VS (<50 copies/mL) was maintained or improved from time of release to the end of the 6-month treatment intervention in those who received XR-NTX, while those who received placebo had decreasing VS levels over time. Furthermore, receiving XR-NTX was statistically associated with a lower proportion of persons losing VS as compared to placebo. After controlling for other factors associated with poor HIV treatment outcomes after release, assignment to XR-NTX alone predicted VS at 6 months after release. These findings have important implications for individual management of PLH with OUD being released from a CJS setting and from a public health perspective.

Recent longitudinal data suggest that in the absence of treatment of OUD, linkage to HIV care post-release is poor and associated with poor VS levels that decreases over time.50 Strategies that optimize VS over time are more likely to promote individual health, but also public health through treatment as prevention efforts.

These findings are especially relevant given the volatile opioid epidemic and associated transmission of HIV and HCV. For prisoners and jail detainees with OUD, including those with HIV, relapse to opioid use exceeds 85%, often within the first two weeks,10 and results in interruptions in HIV care,11 overdose and death.7 In prisoners without HIV, XR-NTX markedly reduces opioid relapse and use.20 This study extends these findings and documents for the first time that XR-NTX stabilizes PLH sufficiently to stabilize them so that they can continue and adhere to ART and maintain or achieve VS.

The mechanism by which XR-NTX maintained or improved VS is not fully understood. In another study of prisoners with HIV and alcohol use disorders, XR-NTX significantly reduced alcohol consumption and exerted its effect on VS.51 The current trial was not powered to demonstrate a difference in opioid relapse outcomes, which were measured using more complex metrics in prior studies of XR-NTX.14,20 In the current trial, however, the only opioid use outcome measured was time to opioid relapse, which was not statistically different between those receiving XR-NTX or placebo in the ITT analysis. A more robust opioid use outcome variable, which might have included a combination of time to relapse, days of opioid use, or continuous days of opioid use might have provided insights into how XR-NTX might have exerted its influence.

In addition, despite a low number of participants, retention on XR-NTX was associated with a longer time to relapse (continued abstinence). Participants who received 3 or more XR-NTX injections had a significantly longer time of continuous abstinence as compared to those who received any number of placebo injections or those who received 2 or fewer injections of XR-NTX. This finding supports longitudinal studies of released prisoners with HIV and OUD who had better HIV treatment outcomes if they were able to remain on buprenorphine longer,11 a medication-assisted treatment for OUD that is a partial opioid agonist/antagonist. Strategies that improve retention on OUD treatment are therefore crucial to optimize VS levels and are especially challenging when using antagonist-based treatments like XR-NTX.16 Cohort studies of released prisoners with HIV, irrespective of having an OUD, suggest VS levels markedly decrease within the first three months after release.3,4,6,50 This period is therefore especially crucial to ensure adequate treatment for both HIV and OUD. Given the chronic and relapsing nature of both HIV and OUD, each of which need a lifetime of treatment, future studies should not only treat and observe patients longer, but should be conducted using other medication-assisted therapies for OUD, like methadone and buprenorphine.

In addition to efficacy outcomes, treatment with XR-NTX is safe, especially given that 80% of the sample had chronic HCV infection. The fatal overdose that occurred that was not related to the study, however, remains concerning and has been raised as a concern in other studies of XR-NTX.52 Death occurred in one participant in the XR-NTX group 128 days after the last injection. This finding is consistent with all other studies of treatment of OUD where discontinuation of treatment, irrespective of the medication, is associated with increased overdose-related death.5356 Prior studies have shown that XR-NTX protects against opioid overdose.20

Despite the important findings and implications of these research findings, some limitations remain. The lower than anticipated sample size concerns have been discussed elsewhere,13,16 but related to introduction of methadone in Connecticut and alternatives to incarceration strategies resulting in fewer numbers of PLH in prison in Connecticut and Massachusetts. Attrition from the study was high, but similar to other studies of released prisoners with OUD.6,57 Despite attrition from the study, VL measurements were high resulting in relatively few missing data that were MCAR, allowing imputation of conservative missing=failure assumptions. This assumption, however, is typically what is considered in ‘real-world’ treatment settings of PLH where the association between poor retention, particularly ‘no-show’ behavior, and poorer biological outcomes is evidenced by virological failure and mortality.58,59 Despite the missing data and lower than expected sample size, the findings remain robust. A larger sample size and better measures of opioid use might have provided better insights into additional factors that might have contributed to VS in this sample.

Conclusion

Findings from this study inform guidelines for treating transitioning prisoners with HIV and OUD with XR-NTX to improve HIV treatment outcomes. Future strategies, however, must optimize treatment retention to reduce opioid use and maintain or increase VS. When XR-NTX is initiated just before release and maintained thereafter, it results in both improved individual and public health benefits. Not only was XR-NTX found to be efficacious, it is also safe in PLH and high levels of HCV.

Acknowledgments

Funding: This research was funded by the National Institutes on Drug Abuse (R01DA030762, Springer) and for career development by the National Institutes on Drug Abuse (K02 DA032322 for Springer and K24 DA017072 for Altice). Both study medication and placebo were provided in-kind from an investigator-initiated application from Alkermes, Inc. The funders were not involved in the research design, analysis or interpretation of the data or the decision to publish the manuscript.

Footnotes

Clinical Trial number: NCT01246401

BIBLIOGRAPHY AND REFERENCES CITED

  • 1.Thompson MA, Mugavero MJ, Amico KR, et al. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care panel. Ann Intern Med. 2012;156(11):817–833. doi: 10.7326/0003-4819-156-11-201206050-00419. W–284, W–285, W–286, W–287, W–288, W–289, W–290, W–291, W–292, W–293, W–294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Spaulding AC, Seals RM, Page MJ, Brzozowski AK, Rhodes W, Hammett TM. HIV/AIDS among inmates of and releasees from US correctional facilities, 2006: declining share of epidemic but persistent public health opportunity. PLoS ONE. 2009;4(11):e7558. doi: 10.1371/journal.pone.0007558. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Meyer JP, Cepeda J, Wu J, Trestman RL, Altice FL, Springer SA. Optimization of human immunodeficiency virus treatment during incarceration: viral suppression at the prison gate. JAMA internal medicine. 2014;174(5):721–729. doi: 10.1001/jamainternmed.2014.601. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Meyer JP, Cepeda J, Springer SA, Wu J, Trestman RL, Altice FL. HIV in people reincarcerated in Connecticut prisons and jails: an observational cohort study. The lancet HIV. 2014;1(2):e77–e84. doi: 10.1016/S2352-3018(14)70022-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Peters RH, Greenbaum PE, Edens JF, Carter CR, Ortiz MM. Prevalence of DSM-IV substance abuse and dependence disorders among prison inmates. Am J Drug Alcohol Abuse. 1998;24(4):573–587. doi: 10.3109/00952999809019608. [DOI] [PubMed] [Google Scholar]
  • 6.Springer SA, Pesanti E, Hodges J, Macura T, Doros G, Altice FL. Effectiveness of antiretroviral therapy among HIV-infected prisoners: reincarceration and the lack of sustained benefit after release to the community. Clin Infect Dis. 2004;38(12):1754–1760. doi: 10.1086/421392. [DOI] [PubMed] [Google Scholar]
  • 7.Springer SA, Spaulding AC, Meyer JP, Altice FL. Public Health Implications for Adequate Transitional Care for HIV-Infected Prisoners: Five Essential Components. Clinical infectious diseases : an official publication of the Infectious Diseases Society of America. 2011;53(5):469–479. doi: 10.1093/cid/cir446. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Binswanger IA, Stern MF, Deyo RA, et al. Release from prison--a high risk of death for former inmates. N Engl J Med. 2007;356(2):157–165. doi: 10.1056/NEJMsa064115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lim S, Seligson AL, Parvez FM, et al. Risks of drug-related death, suicide, and homicide during the immediate post-release period among people released from new york city jails, 2001–2005. Am J Epidemiol. 2012;175(6):519–526. doi: 10.1093/aje/kwr327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Merrall EL, Kariminia A, Binswanger IA, et al. Meta-analysis of drug-related deaths soon after release from prison. Addiction. 2010;105(9):1545–1554. doi: 10.1111/j.1360-0443.2010.02990.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Springer SA, Qiu J, Saber-Tehrani AS, Altice FL. Retention on buprenorphine is associated with high levels of maximal viral suppression among HIV-infected opioid dependent released prisoners. PLoS ONE. 2012;7(5):e38335. doi: 10.1371/journal.pone.0038335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Springer SA, Chen S, Altice FL. Improved HIV and Substance Abuse Treatment Outcomes for Released HIV-Infected Prisoners: The Impact of Buprenorphine Treatment. J Urban Health. 2010;87(4):592–602. doi: 10.1007/s11524-010-9438-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Di Paola A, Lincoln T, Skiest DJ, Desabrais M, Altice FL, Springer SA. Design and methods of a double blind randomized placebo-controlled trial of extended-release naltrexone for HIV-infected, opioid dependent prisoners and jail detainees who are transitioning to the community. Contemp Clin Trials. 2014;39(2):256–268. doi: 10.1016/j.cct.2014.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Krupitsky E, Nunes EV, Ling W, Illeperuma A, Gastfriend DR, Silverman BL. Injectable extended-release naltrexone for opioid dependence: a double-blind, placebo-controlled, multicentre randomised trial. Lancet. 2011;377(9776):1506–1513. doi: 10.1016/S0140-6736(11)60358-9. [DOI] [PubMed] [Google Scholar]
  • 15.Springer SA, Altice FL, Herme M, Di Paola A. Design and methods of a double blind randomized placebo-controlled trial of extended-release naltrexone for alcohol dependent and hazardous drinking prisoners with HIV who are transitioning to the community. Contemp Clin Trials. 2014;37(2):209–218. doi: 10.1016/j.cct.2013.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Springer SA, Brown SE, Di Paola A, Altice FL. Correlates of retention on extended-release naltrexone among persons living with HIV infection transitioning to the community from the criminal justice system. Drug Alcohol Depend. 2015;157:158–165. doi: 10.1016/j.drugalcdep.2015.10.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Vagenas P, Di Paola A, Herme M, et al. An evaluation of hepatic enzyme elevations among HIV-infected released prisoners enrolled in two randomized placebo-controlled trials of extended release naltrexone. J Subst Abuse Treat. 2014;47(1):35–40. doi: 10.1016/j.jsat.2014.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.O’Malley SS, Garbutt JC, Gastfriend DR, Dong Q, Kranzler HR. Efficacy of extended-release naltrexone in alcohol-dependent patients who are abstinent before treatment. Journal of clinical psychopharmacology. 2007;27(5):507–512. doi: 10.1097/jcp.0b013e31814ce50d. [DOI] [PubMed] [Google Scholar]
  • 19.Garbutt JC, Kranzler HR, O’Malley SS, et al. Efficacy and tolerability of long-acting injectable naltrexone for alcohol dependence: a randomized controlled trial. JAMA. 2005;293(13):1617–1625. doi: 10.1001/jama.293.13.1617. [DOI] [PubMed] [Google Scholar]
  • 20.Lee JD, Friedmann PD, Kinlock TW, et al. Extended-Release Naltrexone to Prevent Opioid Relapse in Criminal Justice Offenders. N Engl J Med. 2016;374(13):1232–1242. doi: 10.1056/NEJMoa1505409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Tanum L, Klemmetsby K, Latif Z, et al. The Effectiveness of Injectable Extended-Release Naltrexone vs Daily Buprenorphine-Naloxone for Opioid Dependene: A Randomized Clinical Noninferiority Trial. JAMA Psychiatry. 2017 doi: 10.1001/jamapsychiatry.2017.3206. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Lee J, Nunes E, Novo P, et al. Comparative effectiveness of extended-release naltrexone versus buprenorphine-naloxone for opioid relapse prevention (X:BOT): a multicentre, open-label, randomised controlled trial. The Lancet. 2017 doi: 10.1016/S0140-6736(17)32812-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.International Harm Reduction Development Program (IHRD) of the Open Society Institute (OSI) Barriers to Access: Medication-Assisted Treatment and Injection-Driven HIV Epidemics. New York, NY: Open Society Institute; Apr, 2008. [Google Scholar]
  • 24.Scott NW, McPherson GC, Ramsay CR, Campbell MK. The method of minimization for allocation to clinical trials. a review. Control Clin Trials. 2002;23(6):662–674. doi: 10.1016/s0197-2456(02)00242-8. [DOI] [PubMed] [Google Scholar]
  • 25.Kang M, Ragan BG, Park JH. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train. 2008;43(2):215–221. doi: 10.4085/1062-6050-43.2.215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Tideman RL, Chen MY, Pitts MK, Ginige S, Slaney M, Fairley CK. A randomised controlled trial comparing computer-assisted with face-to-face sexual history taking in a clinical setting. Sexually transmitted infections. 2007;83(1):52–56. doi: 10.1136/sti.2006.020776. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Caldwell DH, Jan G. Computerized assessment facilitates disclosure of sensitive HIV risk behaviors among African Americans entering substance abuse treatment. Am J Drug Alcohol Abuse. 2012;38(4):365–369. doi: 10.3109/00952990.2012.673663. [DOI] [PubMed] [Google Scholar]
  • 28.Sheehan D, Lecrubier Y, Harnett-Sheehan K, et al. Reliability and Validity of the MINI International Neuropsychiatric Interview (M.I.N.I.): According to the SCID-P. European Psychiatry. 1997;12:232–241. [Google Scholar]
  • 29.Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry. 1998;59:22–33. [PubMed] [Google Scholar]
  • 30.Wang J, Kelly BC, Booth BM, Falck RS, Leukefeld C, Carlson RG. Examining factorial structure and measurement invariance of the Brief Symptom Inventory (BSI)-18 among drug users. Addict Behav. 2010;35(1):23–29. doi: 10.1016/j.addbeh.2009.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Delate T, Coons SJ. The discriminative ability of the 12-item short form health survey (SF-12) in a sample of persons infected with HIV. Clin Ther. 2000;22(9):1112–1120. doi: 10.1016/S0149-2918(00)80088-0. [DOI] [PubMed] [Google Scholar]
  • 32.Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993;88(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
  • 33.Sobell L, Sobell M. Timeline followback: a technique for assessing self-reported ethanol consumption. In: RZL JA, editor. Measuring Alcohol Consumption: Psychosocial and Biological Methods. Totowa, NJ: Humana Press; 1992. pp. 41–72. [Google Scholar]
  • 34.Fiellin DA, McGinnis KA, Maisto SA, Justice AC, Bryant K. Measuring Alcohol Consumption Using Timeline Followback in Non-Treatment-Seeking Medical Clinic Patients With and Without HIV Infection: 7-, 14-, or 30-day Recall. J Stud Alcohol Drugs. 2013;74(3):500–504. doi: 10.15288/jsad.2013.74.500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Levine J, Schooler NR. SAFTEE: a technique for the systematic assessment of side effects in clinical trials. Psychopharmacol Bull. 1986;22(2):343–381. [PubMed] [Google Scholar]
  • 36.Pettinati H, Weiss R, Miller WR, Donovan D, Ernst D, BJR NIAAA, editor. Medical Management Treatment Providing Pharmacotherapy as Part of the Treatment for Alcohol Dependence. Bethesda, MD: DHHS; 2004. [Google Scholar]
  • 37.Saber-Tehrani AS, Springer SA, Qiu J, Herme M, Wickersham J, Altice FL. Rationale, study design and sample characteristics of a randomized controlled trial of directly administered antiretroviral therapy for HIV-infected prisoners transitioning to the community - a potential conduit to improved HIV treatment outcomes. Contemp Clin Trials. 2012;33(2):436–444. doi: 10.1016/j.cct.2011.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Little RJA. A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association. 1988;83(404):1198–1202. [Google Scholar]
  • 39.R package version 0.5. [computer program] 2012. R Package for Baylor University Educational Psychology Quantitative Courses. [Google Scholar]
  • 40.Smuk M, Carpenter JR, Morris TP. Erratum to: What impact do assumptions about missing data have on conclusions? a practical sensitivity analysis for a cancer survival registry. BMC medical research methodology. 2017;17(1):51. doi: 10.1186/s12874-017-0323-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Smuk M, Carpenter JR, Morris TP. What impact do assumptions about missing data have on conclusions? A practical sensitivity analysis for a cancer survival registry. BMC medical research methodology. 2017;17(1):21. doi: 10.1186/s12874-017-0301-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.The AVANTI Steering Committee. Analysis of HIV-1 clinical trials: statistical magic? The AVANTI Steering Committee. Lancet. 1999;353(9169):2061–2064. [PubMed] [Google Scholar]
  • 43.Panel on Antiretroviral Guidelines for Adults and Adolescents; Services DoHaH, editor. Guidelines for the Use of Antiretroviral Agents in HIV-1-Infected Adults and Adolescents. Washington, D.C: 2015. [Google Scholar]
  • 44.Altice FL, Bruce RD, Lucas GM, et al. HIV treatment outcomes among HIV-infected, opioid-dependent patients receiving buprenorphine/naloxone treatment within HIV clinical care settings: results from a multisite study. J Acquir Immune Defic Syndr. 2011;56(Suppl 1):S22–32. doi: 10.1097/QAI.0b013e318209751e. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Ruxton GD. The unequal variance t-test is an underused alternative to Student’s t-test and the Mann–Whitney U test. Behavioral Ecology. 2006;17:688–690. [Google Scholar]
  • 46.Mc NQ. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika. 1947;12(2):153–157. doi: 10.1007/BF02295996. [DOI] [PubMed] [Google Scholar]
  • 47.Fay M. Two-sided Exact Tests and Matching Confidence Intervals for Discrete Data. R Journal. 2010;2(1):53–58. [Google Scholar]
  • 48.Fay M, Sally A. exact2×2: xact Tests and Confidence Intervals for 2×2 Tables. R package version 1.5.2. 2017 [Google Scholar]
  • 49.Copersino ML, Meade CS, Bigelow GE, Brooner RK. Measurement of self-reported HIV risk behaviors in injection drug users: comparison of standard versus timeline follow-back administration procedures. Journal of substance abuse treatment. 2010;38(1):60–65. doi: 10.1016/j.jsat.2009.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Loeliger KB, Altice FL, Desai M, Ciarleglio MM, Gallagher C, Meyer JP. Predictors of Linkage to HIV Care and Viral Suppression Levels Following Release from Jails and Prisons: A Retrospective Cohort Study. Lancet HIV. 2017 doi: 10.1016/S2352-3018(17)30209-6. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Springer SA, Di Paola A, Azar MM, Barbour R, Krishnan A, Altice FL. Extended-release naltrexone reduces alcohol consumption among released prisoners with HIV disease as they transition to the community. Drug Alcohol Depend. 2017;174:158–170. doi: 10.1016/j.drugalcdep.2017.01.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Wolfe D, Carrieri MP, Dasgupta N, Wodak A, Newman R, Bruce RD. Concerns about injectable naltrexone for opioid dependence. Lancet. 2011;377(9776):1468–1470. doi: 10.1016/S0140-6736(10)62056-9. [DOI] [PubMed] [Google Scholar]
  • 53.Krupitsky E, Nunes EV, Ling W, Illeperuma A, Gastfriend DR, Silverman BL. Injectable extended-release naltrexone for opioid dependence. Lancet. 2011;378(9792):665. doi: 10.1016/S0140-6736(11)61331-7. author reply 666. [DOI] [PubMed] [Google Scholar]
  • 54.Increase in fatal poisonings involving opioid analgesics in the United States 1999–2006. [Accessed August 20, 2011];National Centre for Health Statistics (NCHS) Data Brief. 2011 http://www.cdc.gov/nchs/data/databriefs/db22.htm.
  • 55.Cornish R, Macleod J, Strang J, Vickerman P, Hickman M. Risk of death during and after opiate substitution treatment in primary care: prospective observational study in UK General Practice Research Database. BMJ (Clinical research ed) 2010;341:c5475. doi: 10.1136/bmj.c5475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Woody GE, Metzger DS. Injectable extended-release naltrexone for opioid dependence. Lancet. 2011;378(9792):664–665. doi: 10.1016/S0140-6736(11)61330-5. author reply 666. [DOI] [PubMed] [Google Scholar]
  • 57.Zelenev A, Marcus R, Kpoelev A, et al. Patterns of Homelessness and Implications for HIV Health After Release from Jail. AIDS And Behavior. 2013;17(Supplement):S181–S194. doi: 10.1007/s10461-013-0472-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Zinski A, Westfall AO, Gardner LI, et al. The Contribution of Missed Clinic Visits to Disparities in HIV Viral Load Outcomes. Am J Public Health. 2015;105(10):2068–2075. doi: 10.2105/AJPH.2015.302695. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Horberg MA, Hurley LB, Silverberg MJ, Klein DB, Quesenberry CP, Mugavero MJ. Missed office visits and risk of mortality among HIV-infected subjects in a large healthcare system in the United States. AIDS Patient Care STDS. 2013;27(8):442–449. doi: 10.1089/apc.2013.0073. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES