Skip to main content
American Journal of Public Health logoLink to American Journal of Public Health
. 2014 Dec;104(12):2385–2391. doi: 10.2105/AJPH.2014.302035

Efficacy of a Process Improvement Intervention on Delivery of HIV Services to Offenders: A Multisite Trial

Frank S Pearson 1,, Michael S Shafer 1, Richard Dembo 1, Graciela del Mar Vega-Debién 1, Jennifer Pankow 1, Jamieson L Duvall 1, Steven Belenko 1, Linda K Frisman 1, Christy A Visher 1, Michele Pich 1, Yvonne Patterson 1
PMCID: PMC4232133  PMID: 25322311

Abstract

Objectives. We tested a modified Network for the Improvement of Addiction Treatment (NIATx) process improvement model to implement improved HIV services (prevention, testing, and linkage to treatment) for offenders under correctional supervision.

Methods. As part of the Criminal Justice Drug Abuse Treatment Studies, Phase 2, the HIV Services and Treatment Implementation in Corrections study conducted 14 cluster-randomized trials in 2011 to 2013 at 9 US sites, where one correctional facility received training in HIV services and coaching in a modified NIATx model and the other received only HIV training. The outcome measure was the odds of successful delivery of an HIV service.

Results. The results were significant at the .05 level, and the point estimate for the odds ratio was 2.14. Although overall the results were heterogeneous, the experiments that focused on implementing HIV prevention interventions had a 95% confidence interval that exceeded the no-difference point.

Conclusions. Our results demonstrate that a modified NIATx process improvement model can effectively implement improved rates of delivery of some types of HIV services in correctional environments.


The National Institute on Drug Abuse launched the Criminal Justice Drug Abuse Treatment Studies, Phase 2 in 2008, under a cooperative agreement with multiple research organizations and a coordinating center. The purpose was to test implementation strategies for health-related interventions for offenders incarcerated in prisons and jails or supervised by probation and parole agencies. The research centers designed the protocols and conducted the trials. The HIV Services and Treatment Implementation in Corrections (HIV-STIC) study evaluated implementation strategies in HIV/AIDS prevention–education, testing, and treatment.

Inmates and other offenders are at high risk for HIV infection, and the rate of confirmed AIDS cases among state and federal prisoners has been about 2.4 times the rate in the general US population.1–4 In 2009, the Centers for Disease Control and Prevention released practice guidelines for managing HIV risk among offenders in correctional systems; they called for HIV testing, prevention programming, and discharge planning for seropositive inmates.5 Although many correctional facilities offer HIV testing, prevention, and antiretroviral medication services, studies have demonstrated that many gaps remain in delivering effective HIV services.6 Furthermore, although inmates identified as HIV positive are provided with antiretroviral therapy (ART) by correctional facilities, gaps in access to medications when inmates are released to the community are common and can have catastrophic consequences for offenders and collateral contacts.7,8

For the HIV-STIC study, we found helpful ideas in the model of implementation research developed by Proctor et al.9,10 They (and other theorists) propose that experimental testing has identified many effective public health interventions, so that now the pressing need is to test implementation strategies to achieve successful use of those interventions in organizations. Another important concept is service penetration to recipients (the number of eligible persons who use a service as a proportion of the total number of persons eligible for the service).10,11 Effective HIV prevention models for correctional populations have been identified,12,13 but transferring these programs from carefully controlled trials into real-world practice is difficult,14,15 and few studies have tested the implementation processes in field settings.14,16

Quality improvement strategies have become common in health care systems. The Network for the Improvement of Addiction Treatment (NIATx)17 trains coaches to help local agency change teams learn how to try out and assess new organizational processes for targeted improvements such as improved patient retention in treatment.18,19

HIV continues to be a major public health problem (even though research has established the efficacy of HIV testing, prevention practices, and ART) because these services have not been adequately implemented for high-risk populations. We sought to expand the new field of implementation science to evidence-based HIV services for a very high-risk population: offenders in correctional facilities or recently released from such facilities. We also tested a NIATx model modified for the implementation of HIV services in prisons and jails.

Nine research centers cooperated in planning and conducting the research. Our long-term goal was improved health services for an at-risk population: offenders under correctional supervision. Specifically, we aimed to more effectively implement improvements in HIV services for preventing, detecting, and treating HIV. Our primary hypothesis was that, compared to the control condition facilities, proportionally more offenders in our experimental condition facilities (where staff were exposed to the modified NIATx model) would receive improved delivery of HIV services.

METHODS

The HIV-STIC study consisted of 14 cluster-randomized trials in which one correctional facility was assigned to the experimental condition (training in HIV services and coaching in a modified NIATx model) and the other was assigned to the control condition (HIV training only). Multilevel hierarchical linear modeling is ordinarily used to analyze cluster-randomized trials. However, this method requires (1) individual-level data and (2) measurement of data on a common dependent variable; HIV-STIC could meet neither of these requirements. In accordance with institutional review board agreements, correctional staff provided us with records of delivery of HIV services to offenders in aggregate form, without individual-level data. We knew that different correctional organizations would choose different types of HIV service improvement outcomes for their experiments.

Meta-analysis is a type of multilevel hierarchical linear modeling analysis that uses summary statistics instead of individual data and combines somewhat different types of outcomes to express effect sizes, such as odds ratios (ORs).20,21 When individual-level data are not available, the intraclass correlation cannot be computed. However, in meta-analytic multilevel analysis, cluster effects are assessed from measures of heterogeneity among the effect sizes of the experiments.22 In prospective meta-analysis, planning is done before the experiments begin to ensure that they have similar interventions and outcomes.23,24

Samples and Settings

Each research center recruited either 1 pair of correctional (prison or jail) facilities to form 1 cluster-randomized trial or 2 pairs of facilities to form 2 independent cluster-randomized trials. Facilities were eligible to form a pair if they were roughly equivalent in (1) population size, (2) custody classification level (minimum or medium security), and (3) identified HIV service needs and problems to be addressed. We excluded maximum security prisons because inmates had much longer sentences and lower release rates, greater restrictions on movement, and more limited access to services.

Centers that intended to improve connection to community care for HIV-positive inmates upon release partnered with community agencies. Although some correctional facilities contracted with or referred clients to multiple HIV service providers, for the experiment we selected only 1 HIV service provider partner for data collection. Our preference was to engage community HIV service programs that (1) served the largest number of offenders, (2) had demonstrated a collaborative disposition in working with the correctional partner and the research center, (3) had provided HIV services to correctional partner clients, either under contract or through referral, and (4) were not too distant from the correctional facility.

The regions where facilities were located were New England (4 jails), Mid-Atlantic (4 work-release facilities linking to community health providers and 2 jails with contracted service providers), East North Central (2 state correctional facilities), East South Central (2 state correctional facilities with 2 community health providers), Mountain (2 county detention facilities and 4 state correctional facilities), Pacific (4 state corrections centers), and Offshore Commonwealth (2 prisons and 2 community providers of HIV treatment).

Administrators of the correctional facilities and the HIV community services organizations agreed that pertinent staff would be available to participate in the HIV-STIC study. These were HIV counselors, prison medical staff, substance abuse treatment staff, and community HIV services staff. We invited certain staff members in the facilities randomly assigned to the experimental condition to participate in the study as members of local change teams (LCTs). Each research center administered informed consent procedures according to its respective institutional review board’s requirements.

Following the baseline training of the staff participants, we randomized correctional sites through a probabilistic random assignment function (RANUNI) in SAS version 9.2 (SAS Institute Inc, Cary, NC) to the experimental or control condition. Reports from senior staff and NIATx coaches and our observations indicated that conditions were followed as randomized.

Objectives

A senior administrator (executive sponsor) in the correctional agency ensured that within each experiment the experimental and control facilities would share the same primary goal, specifically to improve the delivery of the same kind of HIV service to the inmates. Records and observations showed that within each experiment, both experimental and control conditions focused on the same primary goal of HIV service improvement. Between experiments, centers selected different improvement goals, as allowed by the protocol.

Table 1 presents the primary outcomes for delivery of HIV services in the experiments. In addition to the main goal, stated in general terms, it also lists the specific criterion of success. For example, in experiment 5.1, success was operationalized as the number of discharged inmates who ever received HIV prevention education and the total or base as the number of inmates who were discharged during the same period. The operationalized outcomes were in records collected by the staff, who provided aggregated totals of the outcomes to the researchers. For some experiments, senior correctional staff held a strong opinion that 2 primary goals were important; these goals were weighted equally as goal 1a and goal 1b.

TABLE 1—

Primary Outcomes for Delivery of HIV Services: HIV Services and Treatment Implementation in Corrections, United States, 2011–2013

Goal 1a
Goal 1b
Research Center, Experiment Main Goal Criterion of Success, No. Total or Base, No. Criterion of Success, No. Total or Base, No.
3.1 Prevention Inmates who received the prevention intervention Inmates who could have received the prevention intervention . . . . . .
4.1 Linkage of inmates discharged on ART to ART in community Inmates for whom ART was scheduled with community HIV treatment Inmates discharged on ART
4.2 Linkage of inmates discharged on ART to ART in community Inmates for whom ART was scheduled with community HIV treatment Inmates discharged on ART
5.1 Prevention Discharged inmates who ever received prevention education Inmates discharged . . . . . .
5.2 Prevention Discharged inmates who ever received prevention education Inmates discharged . . . . . .
6.1 Linkage of inmates discharged on ART to ART in community Inmates on ART who had contact with community HIV treatment Inmates on ART who were scheduled to receive community HIV treatment Inmates not on ART who had contact with community HIV treatment Inmates not on ART who were scheduled to receive community HIV treatment
7.1 Linkage of inmates discharged on ART to ART in community Inmates on ART who had contact with community HIV treatment Inmates on ART who were scheduled to receive community HIV treatment . . . . . .
8.1 Prevention Inmates contacted by other inmates trained in dissemination of HIV education Inmates targeted for HIV education dissemination by inmates . . . . . .
8.2 Prevention Inmates contacted by other inmates trained in dissemination of HIV education Inmates targeted for HIV education dissemination by inmates . . . . . .
9.1 HIV testing Admitted inmates who were tested for HIV Admitted inmates . . . . . .
9.2 HIV testing Admitted inmates who were tested for HIV Admitted inmates . . . . . .
10.1 Linkage of inmates discharged on ART to ART in community Inmates on ART who were scheduled to receive community HIV treatment HIV-positive inmates discharged Inmates on ART who had contact with community HIV treatment Inmates on ART who were scheduled to receive community HIV treatment
10.2 Linkage of inmates discharged on ART to ART in community Inmates on ART who were scheduled to receive community HIV treatment HIV-positive inmates discharged Inmates on ART who had contact with community HIV treatment Inmates on ART who were scheduled to receive community HIV treatment
11.1 Linkage of inmates discharged on ART to ART in community Inmates on ART who were scheduled to receive community HIV treatment HIV-positive inmates discharged Inmates who refilled ART prescription after release Inmates on ART

Note. ART = antiretroviral therapy; ellipses = not applicable.

Local Change Teams

The executive sponsor appointed a senior administrator in the experimental condition facility (facility sponsor) to oversee LCT activity in the facility. Together they organized an LCT of a few staff persons and appointed 1 person with strong leadership, communication, and delegation skills as team leader. In the experimental condition, the LCT used the NIATx approach, which begins with walking through the service delivery to see it from the service recipient’s point of view and to detect difficulties.17,19 Next, the teams used rapid plan–do–study–act cycles: identify specific problems and generate solutions (plan), try out new processes (do), measure and assess the outcomes (study), and implement the solution or make additional changes (act). LCTs repeated the cycle for any other problems discovered. Teams executed plans for solving each problem 1 at a time, recorded and reviewed results data, and, at the end of each cycle, decided whether to adopt, adapt, or abandon that plan.

The typical LCT had 5 members at the start of the project; 2 left during the project, 3 joined after the start of the project, and 6 remained at the end. Examples of reasons for staff movement out of LCTs were transfer to another facility and retirement and for joining an ongoing project were having needed skills and replacing lost staff.

Study Phases

We held a stakeholder orientation meeting in each corrections agency to bring criminal justice participants and researchers together for an overview of the study protocol, deadlines, and staff time and effort commitment. The Bridging Group, a consulting firm, provided training on HIV services to likely staff participants.25 The first research center held its orientation meeting in February 2011 and the last in April 2012. Participant recruitment began about the time of the orientation meeting, but some new participants entered many months later if the strategies of the LCT required new members.

Collection of baseline survey data occurred soon after the orientation meeting. Randomization of facilities to the experimental or control condition was the next milestone. The intervention phase began at each experimental facility with an initial in-person meeting between the NIATx coach and the LCT to summarize the project, introduce NIATx concepts, and specify the key objectives of the implementation project. The implementation phase (typically 10 months) focused on the LCT carrying out the NIATx rapid-cycle testing activities.17,19

Collection of HIV services records data covering all 14 experiments began with the first baseline months of HIV services records in January 2011, and collection of the final follow-up months of HIV services records ended in July 2013. Some corrections organizations joined HIV-STIC much later than others, so the onset and end of each phase varied substantially across the experiments.

Measures

To assess the experiment’s primary goal of delivering a specific HIV service to people under correctional supervision, we obtained records on the possible outcomes in each condition of the experiment: nS, the number to whom the intervention was successfully delivered; nF, the number who failed to receive the intervention; total N, the total (or targeted base). Thus, nS + nF = total N. The observed probability of success in the sample was nS/total N. The odds of success were nS/nF. Because the data were in the form of success, failure, total, we took the conventional approach of using the OR as the main effect size. The OR was the ratio of the odds of success with experimental treatment over the odds of success with the control treatment.26 For the statistical analysis we followed the standard practice of converting the OR to the log OR.

We considered 3 covariates in assessing whether the modified NIATx organizational process improvement interventions significantly improved the delivery of HIV services in this set of 14 cluster-randomized trials:

  • Targeted outcome. If the general type of primary outcome (prevention, HIV testing, linkage of HIV-positive inmates to ART) chosen for each experiment was related to the effect size, that should be taken into account in interpreting the findings.

  • Baseline effect size. This is the effect size comparing the experimental group to the control group prior to the intervention. If either experimental or control groups appeared to be significantly more successful at baseline, including that as a moderator variable should help us to understand the findings.

  • Fidelity. If some of the actual interventions were poor and others were good approximations of the NIATx model, that should be included as a moderator variable.

As is standard practice, for the statistical analysis we added a conventional value of 0.5 to any number of successes exactly equal to zero (to avoid the impermissible operation of division by zero), and we used the logarithm of the OR (because that method makes that effect size symmetric around 0 and has sampling distributions that are closer to normality27,28). We then converted the results back into OR form. We conducted a meta-analysis for a hypothesis test of the primary outcome, followed by a meta-analysis or a meta-regression in which we controlled for potential moderator variables. For those key analyses we used Comprehensive Meta-Analysis version 2.2.05529 and the Metafor statistical package version 1.8-030 in R statistical software version 3.0.1.31

RESULTS

The data collected to measure the primary outcomes are presented in Table 2. The number of inmates targeted for improved HIV services (total) varied greatly. Some criminal justice facilities had many inmates who had not been tested for HIV and many who had not received any HIV prevention intervention, but relatively few inmates who were HIV positive and in need of ART. In both the experimental and the control condition, the targeted total number for delivery of the HIV service and the number of inmates to whom that HIV service was successfully delivered enabled us to calculate the conventional effect size OR. We used random-effects statistical models.

TABLE 2—

Delivery of HIV Services: Experiments, Effect Sizes, Meta-Analysis on HIV Services and Treatment Implementation in Corrections, United States, 2011–2013

Experimental Condition
Control Condition
Research Center, Experiment Success, No. Total, No. Success, No. Total, No. OR (95% CI) Log OR SE
3.1 219 1599 89 4606 8.05 (6.25, 10.38) 2.09 0.13
4.1 10 10 0.5a 1 21.00 (0.40, 1108.59) 3.04 2.02
4.2 0.5 1 0.5 1 1.00 (0.00, 255.60) 0.00 2.83
5.1 36 272 0.5 208 63.31 (3.86, 1038.14) 4.15 1.43
5.2 17 55 121 558 1.62 (0.88, 2.96) 0.48 0.31
6.1b 29 33 30 36 1.45 (0.37, 5.67) 0.37 0.70
7.1 6.5 7 2 2 1.40 (0.03, 56.01) 0.34 1.88
8.1 96 1970 30 1602 2.68 (1.77, 4.07) 0.99 0.21
8.2 32 475 42 473 0.74 (0.46, 1.20) −0.30 0.24
9.1 794 1650 812 1650 0.96 (0.84, 1.10) −0.04 0.07
9.2 873 1650 721 1650 1.45 (1.26, 1.66) 0.37 0.07
10.1b 3 4 1.3 4 6.23 (0.29, 135.86) 1.83 1.57
10.2b 0.5 1 3.9 11 1.82 (0.03, 110.95) 0.60 2.10
11.1b 0.5 454 0.5 546 1.20 (0.02, 60.74) 0.18 2.00

Note. CI = confidence interval; OR = odds ratio. On meta-analysis, the random-effects model OR = 2.14 (95% CI = 1.20, 3.80; P = .01) and Q = 235.8 (df = 13; P < .001; I2 = 94.5; τ2 = 0.63).

a

As is standard practice in computations with OR data, Comprehensive Meta-Analysis provided slight adjustments for very small numbers (e.g., to avoid attempting to divide by zero); 0.5 was added.

b

Experiment in which the corrections staff had a strong opinion that 2 primary goals were equally important; these 2 primary goals were weighted equally in the analyses.

The results of the critical null hypothesis test of the meta-analysis relating the primary outcome to the experimental versus control condition are summarized in the note at the bottom of Table 2. Our significance test at the .05 level led us to reject the null hypothesis of no difference between the experimental and control conditions, because the computed probability was .01. The point estimate for the log OR was 0.76 (95% confidence interval [CI] = 0.18, 1.33). Those statistics corresponded to a point estimate for the OR of 2.14 (95% CI = 1.20, 3.80). The conversion functions in Comprehensive Meta-Analysis software showed that the point estimate OR of 2.14 converted to a Cohen d of 0.42, an effect size conventionally considered between small and medium.32

Statistics on the heterogeneity of the experimental results also appear in the note to Table 2. The Q test result of P < .001 indicated that the studies probably did not share a common effect size,22 and an I2 = 94.5 could be characterized as high heterogeneity.33 Therefore, we investigated 3 potential moderator variables.

First, we analyzed a categorical moderator variable, the main goal of the experiments, shown in Figure 1, which is a forest plot of the 14 experiments. As shown in the scale at the bottom, the effect size is the logarithm of the OR, and that provides its zero point as a convenient vertical reference line in the middle of the graph, with successful experiments displayed to the right of the zero point. The left column shows the labels for research centers and their experiment(s). The second column shows the main goal of each experiment, with the 5 HIV prevention experiments near the top, the 2 HIV-testing experiments just below that, and the 7 linkage to HIV treatment experiments at the bottom of the plot. Within each of those 3 separate goals, the experiments are sorted in descending order of their effect sizes. On the right is each log OR and its associated 95% CI. Below the 14 experiments, RE model indicates random-effects model. The black diamond just above the scale at the bottom shows that the meta-analysis finding is to the right of, and does not overlap, the 0.00 point; thus the meta-analysis is statistically significant.

FIGURE 1—

FIGURE 1—

Forest plot of experiments sorted by main goal then by effect size in descending order: HIV Services and Treatment Implementation in Corrections, United States, 2011–2013.

Note. Numbers in parentheses are 95% confidence intervals.

To the right of the diamond are the overall summary log OR and its associated 95% CI. The forest plot displays experiments with proportionately larger sample sizes having narrower CIs (e.g., 8.1 and 8.2) and experiments with smaller sample sizes with proportionately wider (uncertain) CIs (e.g., 4.1 and 4.2). In the actual moderator analysis, the log ORs were (1) prevention, 1.13 (95% CI = 0.05, 2.21; P = .04); (2) HIV testing, 0.16 (95% CI = −0.24, 0.57; P = .43); and (3) linkage to treatment, 0.70 (95% CI = −0.33, 1.74; P = .18). The results for HIV prevention did not include the zero log OR (i.e., no-difference point), indicating that HIV prevention mainly accounted for the significant overall null hypothesis test.

We also used meta-regressions to assess 2 interval-level variables as potential moderators. One covariate of interest was the effect size comparing the experimental to the control group prior to the intervention. In the matched pair of corrections facilities, we used random assignment to limit differences in the levels of the chosen HIV service delivery prior to the intervention. If the effect sizes at baseline seemed to have little or no relation to the effect sizes at follow-up (as intended), then the findings would be easy to interpret. However, if either the experimental or control group appeared to be significantly more successful at baseline, this effect should be estimated statistically in analyses after the critical test. The log OR at baseline showed that (as intended) this variable was not statistically significant (exact P = .32).

We assessed the fidelity of the actual LCT interventions to the NIATx model with an instrument constructed during this project. Four items rated structural components (e.g., a senior staff person able to bring resources to the change team). Six rated the process (i.e., plan, do, study, act). Eight (reverse coded) rated problems (e.g., the LCT’s meetings were too infrequent). A meta-regression that included the rating of fidelity to NIATx showed that the rating of fidelity was not even close to being a significant predictor (exact P = .86) of the effect sizes.

We also examined how influential each experiment was on the overall results, performing diagnostic tests while removing 1 experiment at a time from the meta-analysis. We used the influence function in the Metafor package to conduct that procedure. The values of 2 statistics (rstudent = 3.17 and dffits = 1.96) indicated that experiment 3.1 had a significant influence on the overall results. We think that this degree of influence was a result of its large sample sizes, especially in the control condition.

DISCUSSION

In the correctional settings of our 14 cluster-randomized trials, addition of a modified NIATx change team approach doubled the odds of successful delivery of HIV services (point estimate for OR = 2.14). The HIV services under investigation were successfully delivered to 26% of the targeted inmates in the experimental condition and 16% in the control group.

Strengths and Limitations

Validity of our results was good (although not excellent) on 4 dimensions widely considered to be important.34 The study design (a prospective meta-analysis of cluster-randomized trials) reduced problems of internal validity. It is relatively unlikely that some factor other than the NIATx change team approach caused the improvement that we observed.

External validity was reasonably good. If we had had the luxury of drawing random samples of prisons and jails from across the United States, and if they had almost all agreed to carry out the experiments, the external validity would have been much stronger. However, the diversity of states and correctional facilities included suggests that the modified NIATx intervention was effective across variations in persons, settings, and treatment variables.34

Field experiments encounter many potential threats to construct validity. A potential threat in our study was novelty and disruption effects, because “[p]articipants may respond unusually well to a novel innovation or unusually poorly to one that disrupts their routine.”34(p73) Reports from the field suggested that a few members of the NIATx change teams found it new and interesting but that more staff limited their LCT participation to keep up with the routine duties of their work in the correctional organization. We do not know the net effect of these factors.

Statistical conclusion validity was also reasonably strong, considering that we conducted our experiments in the real world of prisons and jails and that the NIATx model is itself an intervention intended to be flexible and adaptive to the realities in the field. If the heterogeneity of the units is considered a threat to internal validity because it makes “detection of a relationship more difficult,”34(p45) then this threat was not fatal to our study.

One of the post hoc tests of moderators was to examine the heterogeneity of effect sizes related to the 3 general HIV goals (prevention, testing, and linkage to ART). The experiments that had HIV prevention as their primary goal had a point estimate of the OR of 3.10, an effect size that would probably be considered of at least medium strength. That set of experiments had a 95% CI that was positive and excluded a no-difference point, suggesting that future research on a similar modified NIATx approach to increasing prevention will probably also find significant positive results. The experiments that had linkage to ART in the community as their primary goal had a point estimate OR of 2.02 (which corresponds to a Cohen d of 0.39, considered intermediate between a small and medium effect). However, those experiments had a lower limit of the 95% CI that included the no-difference point. It should be noted that although the prevention experiments had a combined total of 11 818 inmates, the linkage to ART experiments had a total of 1111, producing lower statistical power and a wider 95% CI.

Only 2 experiments had HIV testing as their primary goal, both of them conducted by the same research center. The point estimate OR was 1.18, which would probably be considered a very small effect. The 95% CI included the no-effect point. A possible reason for the lack of success was staff dissatisfaction: some staff expressed concerns about being asked to do change team work in addition to their regular duties without receiving compensation or extra help.

Conclusions

Our study provides an important step toward reducing the spread of HIV among offenders and in the communities to which inmates return. Our study was a rare effort to apply NIATx-type process improvement services in correctional settings.35,36 Little was known about effective strategies for implementing this service improvement model in jails or prisons or in probation or parole settings. Future implementation studies that target correctional settings should consider conducting a preimplementation pilot study to identify potential problems (e.g., the staff dissatisfaction encountered by 1 research center).

Our study was part of efforts in the relatively new field of implementation science,35 focused here on health-related interventions for offenders under correctional supervision. We hope that other researchers will advance these efforts to improve the quality of services for at-risk and HIV-positive offenders and strengthen the measurement and assessment of the impact of these services. The next step to advance these efforts is for practitioners and researchers to engage in conceptual development and in pilot testing to strengthen our modified NIATx approach, particularly to improve the effect sizes that we found for linkage to ART in the community and for HIV testing in prisons and jails.

Acknowledgments

This study was funded under a cooperative agreement with the US Department of Health and Human Services, the National Institute on Drug Abuse (NIDA), the Substance Abuse and Mental Health Services Administration, and the Bureau of Justice Assistance. We gratefully acknowledge the collaborative contributions by NIDA; the Coordinating Center, AMAR International Inc; and the research centers participating in the Criminal Justice Drug Abuse Treatment Studies (CJ-DATS). The research centers were Arizona State University and Maricopa County Adult Probation (grant U01DA025307); University of Connecticut and the Connecticut Department of Correction (grant U01DA016194); University of Delaware, Delaware Department of Correction, and Christiana Care HIV Wellness Program (grant U01DA016230); Friends Research Institute (grant U01DA025233) and Maryland Department of Public Safety Correctional Services’ Division of Parole and Probation; University of Kentucky and Kentucky Department of Corrections (grant U01DA016205); National Development and Research Institutes Inc and Colorado Department of Corrections (grant U01DA016200); Rhode Island Hospital–Brown University, University of Rhode Island, University of Puerto Rico, Rhode Island Department of Children, Youth and Families, and Rhode Island and Puerto Rico Departments of Corrections (grant U01DA016191); Texas Christian University and Illinois and Virginia Departments of Corrections (grant U01DA016190); Temple University and Pennsylvania Department of Corrections (grant U01DA025284); and University of California at Los Angeles and Washington State Department of Corrections (grant U01DA016211).

Note. The contents are solely the responsibility of the authors and do not necessarily represent the views of the Department of Health and Human Services, NIDA, or other CJ-DATS parties.

Human Participant Protection

Each research center that participated in this multisite trial received protocol approval from its institutional review board.

References

  • 1.Belenko S, Foltz C, Lang MA, Sung H-E. Recidivism among high-risk drug felons: a longitudinal analysis following residential treatment. J Offender Rehabil. 2004;40(1–2):105–132. [Google Scholar]
  • 2.Martin SS, O’Connell DJ, Inciardi JA, Surratt HL, Beard RA. HIV/AIDS among probationers: an assessment of risk and results from a brief intervention. J Psychoactive Drugs. 2003;35(4):435–443. doi: 10.1080/02791072.2003.10400490. [DOI] [PubMed] [Google Scholar]
  • 3.Maruschak LM, Beavers R. HIV in Prisons, 2007–08. Bur Justice Stat Bull. 2009:1–12. Available at: http://correctionalhealthcareworkgroup.webs.com/hivp08.pdf. Accessed June 12, 2014. [Google Scholar]
  • 4.Centers for Disease Control and Prevention. HIV in correctional settings. Available at: http://www.cdc.gov/hiv/resources/factsheets/pdf/correctional.pdf. Accessed December 6, 2013.
  • 5.Centers for Disease Control and Prevention. HIV testing implementation guidance for correctional settings. 2009. Available at: http://www.cdc.gov/correctionalhealth/rec-guide.html. Accessed November 6, 2013.
  • 6.Hammett TM. HIV/AIDS and other infectious diseases among correctional inmates: transmission, burden, and an appropriate response. Am J Public Health. 2006;96(6):974–978. doi: 10.2105/AJPH.2005.066993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Meyer JP, Chen NE, Springer SA. HIV treatment in the criminal justice system: critical knowledge and intervention gaps. Aids Res Treat. 2011;2011:680617. doi: 10.1155/2011/680617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Springer SA, Spaulding AC, Meyer JP, Altice FL. (2011). Public health implications for adequate transitional care for HIV-infected prisoners: five essential components. Clin Infect Dis. 53(5):469–479. doi: 10.1093/cid/cir446. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34. doi: 10.1007/s10488-008-0197-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Proctor E, Silmere H, Raghavan R et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Stiles PG, Boothroyd RA, Snyder K, Zong X. Service penetration by persons with severe mental illness: how should it be measured? J Behav Health Serv Res. 2002;29(2):198–207. doi: 10.1007/BF02287706. [DOI] [PubMed] [Google Scholar]
  • 12.Centers for Disease Control and Prevention. Compendium of evidence-based HIV behavioral interventions. Available at: http://www.cdc.gov/hiv/prevention/research/compendium/index.html. Accessed December 13, 2013.
  • 13.Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2:42. doi: 10.1186/1748-5908-2-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Solomon J, Card JJ, Marlow RM. Adapting efficacious interventions: advancing translational research in HIV prevention. Eval Health Prof. 2006;29(2):162–194. doi: 10.1177/0163278706287344. [DOI] [PubMed] [Google Scholar]
  • 15.Kelly JA, Heckman TG, Stevenson LY et al. Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. AIDS Educ Prev. 2000;12(5 suppl):87–98. [PubMed] [Google Scholar]
  • 16.Sussman S, Valente TW, Rohrbach LA, Skara S, Pentz MA. Translation in the health professions: converting science into action. Eval Health Prof. 2006;29(1):7–32. doi: 10.1177/0163278705284441. [DOI] [PubMed] [Google Scholar]
  • 17. NIATx. Removing barriers to treatment and recovery. Available at: http://www.niatx.net/Home/Home.aspx?CategorySelected=HOME. Accessed December 8, 2013.
  • 18.Capoccia VA, Cotter F, Gustafson DH et al. Making “stone soup”: improvements in clinic access and retention in addiction treatment. Jt Comm J Qual Patient Saf. 2007;33(2):95–103. doi: 10.1016/s1553-7250(07)33011-0. [DOI] [PubMed] [Google Scholar]
  • 19.McCarty D, Gustafson D, Wisdom J et al. The Network for the Improvement of Addiction Treatment (NIATx): enhancing access and retention. Drug Alcohol Depend. 2007;88(2–3):138–145. doi: 10.1016/j.drugalcdep.2006.10.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Bryk AS, Raudenbush SW. Hierarchical Linear Models: Applications and Data Analysis Methods. 2nd ed. Newbury Park, CA: Sage Publications; 2002. [Google Scholar]
  • 21.Hox J. Multilevel Analysis: Techniques and Applications. Mahwah, NJ: Lawrence Erlbaum Associates; 2002. [Google Scholar]
  • 22.Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. Chichester, West Sussex, UK: Wiley; 2009. [Google Scholar]
  • 23.Banks S, McHugo GJ, Williams V, Drake RE, Shinn M. A prospective meta-analytic approach in a multisite study of homelessness prevention. New Dir Eval. 2002;2002(94):45–60. [Google Scholar]
  • 24.Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F. Methods for Meta-Analysis in Medical Research. New York, NY: Wiley; 2000. [Google Scholar]
  • 25.The Bridging Group. Available at: http://www.thebridginggroup.com/about.html. Accessed December 13, 2013.
  • 26.Practice Committee of the American Society for Reproductive Medicine. Interpretation of clinical trial results. Fertil Steril. 2008;90(suppl 3):S114–S120. doi: 10.1016/j.fertnstert.2008.08.037. [DOI] [PubMed] [Google Scholar]
  • 27.Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. 2010;36(3):1–48. [Google Scholar]
  • 28.Lipsey MW, Wilson DB. Practical Meta-Analysis. Thousand Oaks, CA: Sage; 2001. [Google Scholar]
  • 29.Borenstein M, Hedges L, Higgins J, Rothstein H. Comprehensive Meta-Analysis. 2nd version. Englewood, NJ: Biostat; 2005. [Google Scholar]
  • 30.Viechtbauer W. Package metafor version 1.8-0 manual. Available at: http://www.wvbauer.com. Accessed August 18, 2013.
  • 31. R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing. Available at: http://www.R-project.org. Accessed December 13, 2013.
  • 32.Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988. [Google Scholar]
  • 33.Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–560. doi: 10.1136/bmj.327.7414.557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin; 2002. [Google Scholar]
  • 35.Wexler HK, Zehner M, Melnick G. Improving drug court operations: NIATx organizational improvement model. Drug Court Rev. 2012;8(1):80–95. [Google Scholar]
  • 36.Robillard AG, Gallito-Zaparaniuk P, Braithwaite R, Arriola KJ, Kennedy S. Providing HIV services for incarcerated and ex-offender populations: perspectives of frontline staff. J HIV AIDS Soc Serv. 2009;8(1):95–113. [Google Scholar]

Articles from American Journal of Public Health are provided here courtesy of American Public Health Association

RESOURCES