Abstract
Prior studies in Drug Courts reported improved outcomes when participants were matched to schedules of judicial status hearings based on their criminological risk level. The current experiment determined whether incremental efficacy could be gained by periodically adjusting the schedule of status hearings and clinical case-management sessions in response to participants’ ensuing performance in the program. The adjustments were made pursuant to a priori criteria specified in an adaptive algorithm. Results confirmed that participants in the full adaptive condition (n = 62) were more than twice as likely as those assigned to baseline-matching only (n = 63) to be drug-abstinent during the first 18 weeks of the program; however, graduation rates and the average time to case resolution were not significantly different. The positive effects of the adaptive program appear to have stemmed from holding noncompliant participants more accountable for meeting their attendance obligations in the program. Directions for future research and practice implications are discussed.
Over 80 percent of criminal offenders in the United States meet a broad definition of substance involvement; specifically, they were arrested for a drug or alcohol-related offense, were intoxicated at the time of their offense, reported they committed their offense to support a drug habit, or have a serious history of substance abuse (National Center on Addiction & Substance Abuse, 2010). Approximately one half of offenders satisfy diagnostic criteria for substance abuse or dependence (Fazel, Bains, & Doll, 2006; Karberg & James, 2005; Zhang, 2003).
Continued substance abuse is associated with a two- to four-fold increase in the likelihood of recidivist criminal offending (Bennett, Holloway, & Farrington, 2008). Providing substance abuse treatment can reduce recidivism rates significantly (Chandler, Fletcher, & Volkow, 2009); however, drug offenders are notorious for failing to comply with conditions to attend substance abuse treatment. Unless they are closely supervised and receive meaningful consequences for failing to attend treatment sessions, less than one quarter of drug offenders may be expected to complete a treatment episode (Marlowe, 2002; UCLA, 2007).
Drug Courts
Drug Courts were created to enhance offenders’ compliance with substance abuse treatment. Drug Courts are special criminal court dockets that provide a judicially supervised regimen of substance abuse treatment and other indicated services in lieu of prosecution or incarceration (National Association of Drug Court Professionals, 1997). Participants undergo random, weekly drug testing and attend regular status hearings in court, during which the judge reviews their progress in treatment and may impose a range of consequences contingent upon their performance. These consequences may include punitive sanctions (e.g., writing assignments, community service or brief jail detention), desired rewards (e.g., verbal praise, reduced supervision requirements or token gifts) or modifications to the participant’s treatment plan (e.g., transfer to a more intensive modality of care).
The consequences are typically administered by the judge in open court, after the Drug Court team has met privately in a staff meeting to review the case and reach a tentative determination about the appropriate course of action. The various team members—which often include representatives of the court, prosecution, defense bar, treatment providers, case managers and probation officers—contribute information from their perspectives about participants’ progress in the program, and may offer recommendations for suitable responses; however, the judge is legally and ethically required to make the final decision about what consequences to impose, after giving due consideration to all of the relevant information and discussing the matter with the participant in court.
In pre-adjudication Drug Courts, graduates have their charge(s) withdrawn and may also have an opportunity to have the offense expunged from their record. Although the record is usually not literally erased from criminal justice databases, record expungement ordinarily entitles the individual to respond truthfully on an employment application or similar document that the arrest or conviction did not occur (Festinger, DeMatteo, Marlowe, & Lee, 2005). In post-adjudication Drug Courts, graduates may avoid incarceration, reduce the conditions of their probation, or consolidate multiple probationary sentences.
Six meta-analyses conducted by independent investigators concluded that Drug Courts significantly reduced criminal recidivism (typically measured by re-arrest rates) by an average of 8 to 26 percentage points (Aos, Miller, & Drake, 2006; Downey & Roman, 2010; Latimer, Morton-Bourgon,& Chretien, 2006; Lowenkamp, Holsinger, & Latessa, 2005; Shaffer, 2010; Wilson, Mitchell, & MacKenzie, 2006). A recent cost-related meta-analysis concluded Drug Courts produced an average of $2.21 in direct benefits to the criminal justice system for every $1.00 invested (Bhati, Roman, & Chalfin, 2008). Yet, despite their proven efficacy, Drug Courts serve only about 5 to 10 percent of the roughly 1.5 million adults arrested each year in the U.S. who meet criteria for substance abuse or dependence (Bhati et al., 2008). If Drug Courts are to extend their reach to the larger at-risk population, it may no longer be feasible for team members to meet regularly in staff meetings to review all of the cases. It will become necessary to model how well-functioning Drug Courts typically respond to various presentations by participants, and routinize or standardize that process so that it may be reliably implemented with larger populations of offenders (Farole, Puffett, Rempel, & Byme, 2004). In the treatment literature, this process of standardizing clinical or supervisory interventions is referred to as adaptive programming.
Adaptive Programming
Adaptive programs adjust the dose or type of services that are administered in response to participants’ clinical presentation or performance in treatment (McKay, 2009). The decision rules or algorithms are specified a priori; that is, before treatment has been initiated (Collins, Murphy, & Bierman, 2004; Murphy, Lynch, McKay, Oslin, & TenHave, 2007). In this way, decisions are guided primarily by the research evidence rather than by individual professional judgment, which can be negatively influenced by such factors as time pressures, insufficient expertise, or personal biases (Andrews & Bonta, 2010; Wormith & Goldstone, 1984). Treatment professionals retain authority to override or alter an indicated adaptive response; however, they are typically requested to articulate the rationale for doing so in the participant’s record.
Matching services to participants’ pre-treatment characteristics is the simplest form of adapting treatment to the needs of the individual. For example, tailoring services to the needs of youths or racial minorities is one common approach to adapting treatment for the individual. At a more sophisticated level, the nature or intensity of services is periodically adjusted as a consequence of participants’ ensuing performance in treatment. For example, if a participant misses a specified number of counseling sessions, he or she might be assigned to a motivational enhancement intervention. The term matching is commonly used to describe strategies that tailor treatment to participants’ baseline characteristics, whereas the term adaptive is generally reserved for strategies that adjust the interventions over the course of treatment.
Noncompliance vs. Non-responsiveness
Selecting adaptive interventions can be complicated when dealing with drug-offender populations, who are jointly supervised by the criminal justice and substance abuse treatment systems. Criminal justice professionals are primarily charged with protecting public safety, and are empowered to respond to misconduct with enhanced supervision or punitive sanctions. Treatment professionals are primarily charged with improving the health of their clients, and may intensify a client’s treatment plan in furtherance of these goals. This requires a distinction to be drawn between noncompliance with supervision requirements and non-responsiveness to the clinical interventions (Marlowe, 2008).
For example, if a Drug Court participant fails to attend counseling sessions, he or she is arguably engaged in willful noncompliance, assuming the absences were unexcused and avoidable. Under such circumstances, it might be appropriate to apply a punitive sanction or increase the participant’s supervision requirements as a consequence for the infraction. On the other hand, if a participant is meeting his or her obligations in the program, but is not responding to the clinical interventions, the fault might lie not with the participant but with the treatment plan. Rather than apply a punitive sanction, it might be preferable to alter the treatment regimen (Marlowe & Wong, 2008).
Distinguishing between noncompliance and non-responsiveness addresses an important problem that is commonly encountered in correctional rehabilitation programs. Some judges or probation officers may increase treatment requirements as a consequence for misconduct in the program. For example, a participant who misses several counseling sessions might be “sanctioned” with a requirement to attend residential treatment. This practice not only risks wasting scarce treatment resources, but may give the inadvertent message to participants that treatment is aversive and something to be avoided. Treatment should be used to address clinical symptoms and not to punish willful misconduct.
Baseline-Matching Studies
Beginning in 1999, our research team initiated a planned sequence of experiments aimed at matching the intensity of judicial supervision in Drug Courts to the risk level of participants. According to the criminological paradigm of the Risk Principle, intensive court monitoring would be expected to exert the greatest benefits for high-risk offenders who have more severe antisocial propensities or treatment-refractory drug use histories, but may be unnecessary or contraindicated for low-risk offenders (Andrews & Bonta, 2010; Taxman & Marlowe, 2006). High-risk offenders often require intensive and sustained interventions to dislodge their entrenched, negative behavioral patterns. Low-risk offenders, in contrast, are less likely to be on a fixed antisocial trajectory and are apt to improve their conduct following a criminal arrest. Therefore, intensive court supervision may offer few incremental benefits for these individuals, but at a substantial cost (DeMatteo, Marlowe, & Festinger, 2006).
Among drug offenders, the most reliable and robust risk factors for failure in traditional rehabilitation programs include a younger age, male gender, adolescent onset of delinquency or substance abuse, prior felony convictions, a co-existing diagnosis of antisocial personality disorder (APD), previously unsuccessful attempts at drug abuse treatment, and a history of violence (Marlowe, Patapis, & DeMatteo, 2003a). We hypothesized that participants with some of these risk factors would benefit most from intensive judicial monitoring.
In the first study, consenting participants in a misdemeanor Drug Court were randomly assigned to attend judicial status hearings on a bi-weekly basis (every 2 weeks) throughout their enrollment in the program, or to be monitored by their clinical case managers who requested court hearings as needed in response to serious or repeated infractions. Results revealed no main effects of status hearings on counseling attendance, urine drug test results, graduation rates, or criminal activity during participants’ enrollment in the Drug Court or at 12 months post-entry (Festinger, Marlowe, Lee, Kirby, Bovasso, & McLellan, 2002; Marlowe, Festinger, Lee, Schepise, Hazzard, Merrill, Mulvaney, & McLellan, 2003b; Marlowe, Festinger, Dugosh, & Lee, 2005a). As hypothesized, however, planned interaction analyses confirmed that high-risk participants who (1) met DSM-IV diagnostic criteria (American Psychiatric Association, 2000) for APD or (2) had a history of drug abuse treatment, provided more drug-negative urine specimens and were more likely to graduate from the Drug Court when they were assigned to biweekly court hearings (Festinger et al., 2002).
These results were replicated in felony and misdemeanor Drug Courts located in urban and rural communities (Marlowe, Festinger, & Lee, 2004a; 2004b). Subsequently, the findings were confirmed using a prospective-matching design, which brought the interaction effects under experimental control. Participants were randomly assigned to be matched or unmatched. Unmatched participants attended status hearings as-usual in the Drug Court, which was every 4 to 6 weeks. Matched participants were scheduled to attend either bi-weekly court hearings or as-needed hearings, depending upon whether they met the above criteria for being high risk or low risk. The results confirmed that high-risk participants attended significantly more counseling sessions, provided significantly more drug-negative urine specimens, and graduated at a significantly higher rate when they were matched to bi-weekly court hearings (Marlowe, Lee, Dugosh, & Benasutti, 2006; Marlowe, Festinger, Dugosh, Lee, & Benasutti, 2007). On the other hand, outcomes were equivalent for the low-risk participants regardless of how often they were required to appear before the judge in court.
Adaptive Pilot Study
The baseline-matching studies represented a first step in tailoring adaptive interventions for drug-abusing offenders. No measurement tool is perfectly valid and reliable, and there will often be an appreciable number of false positives and false negatives in any program. Some offenders with poor prognoses will be erroneously assigned to low-intensity conditions, and others with good prognoses will be assigned to high-intensity conditions. A mechanism must be established to adjust the initial placement as a consequence of their subsequent performance in treatment.
It was also noteworthy that the baseline-matching procedure elicited improvements for the high-risk participants, but not for the low-risk participants who comprised nearly one half to two thirds of the samples. It is possible that some individuals were low risk from a criminological perspective, but still had serious treatment needs that were not being addressed by increasing their contacts with a judge.
We pilot tested an adaptive algorithm that distinguished between noncompliance with the supervisory conditions of the Drug Court and non-responsiveness to the clinical interventions. The algorithm was developed through a collaborative process between the Drug Court team and research staff. Interventions were chosen that are commonly used in Drug Courts, and criteria for noncompliance and non-responsiveness were selected that are easily and objectively measurable (see Figure 1).
Figure 1.
Adaptive algorithm. High risk = meets DSM-IV diagnostic criteria for antisocial personality disorder (APD) or has a history of drug abuse treatment, excluding self-help groups. Low risk = does not meet criteria for APD and has no history of drug abuse treatment.
The first step in the adaptive algorithm was identical to the previous baseline-matching procedure. Subsequently, participants were assessed at monthly intervals to determine how they were progressing in the program. Those who had two or more unexcused absences from counseling sessions, or two or more unexcused failures to provide a valid urine specimen, were determined to be noncompliant with the conditions of the program. For them, the schedule of court hearings was increased. If they had previously been assigned to as-needed court hearings, they were re-assigned to bi-weekly hearings. If they were already on a bi-weekly schedule, they were placed on a jeopardy contract. A jeopardy contract involves “zero tolerance” for further violations of the rules of the program. Any further violation leads to a termination hearing, also known as a show-cause hearing, at which the participant is terminated from the program and sentenced on the original charge(s) unless he or she can provide a good-cause reason to be given another chance. The decision whether or not to permit another chance is within the discretion of the judge and is generally granted in approximately 30 percent of cases.
Participants who provided two or more drug-positive urine specimens were determined to be non-responsive to the clinical interventions. Those individuals were referred to an intensive clinical case-management (ICCM) program. Participants in ICCM were required to attend two additional therapeutic group sessions per week and one additional individual treatment session per month. The interventions were administered by a clinically trained case manager and focused on motivational enhancement and relapse prevention techniques.
Consenting participants were randomly assigned at entry to Drug Court as-usual (n = 14) or to the adaptive intervention (n = 16). This pilot trial was not intended to be statistically powered to detect modest effects. The aims were limited to determining whether the adaptive algorithm was feasible to implement in a real-world Drug Court, and whether it showed sufficient promise to justify the cost and effort of a fully powered experimental trial. Results revealed the adaptive algorithm was acceptable to participants and staff, and showed substantial promise for improving outcomes. The estimated effect sizes (ES’s) ranged from 0.40 to 0.60 (in the moderate to large range) across various dependent measures, including drug-negative urine specimens and on-time graduation rates (Marlowe, Festinger, Arabia, Dugosh, Benasutti, Croft, & McKay, 2008). It also took an average of approximately 4 fewer months for participants in the adaptive condition to graduate from the program or reach a final resolution of the case (Marlowe, Festinger, Arabia, Dugosh, Benasutti, & Croft, 2009).
Data from the pilot study suggested a possible mechanism of action for the adaptive program. Employing the same criteria for noncompliance and non-responsiveness as for the adaptive condition, participants in the as-usual condition were much less likely to receive a consequence for inadequate performance. Consequences were imposed only 31 percent of the time when they were indicated for the as-usual participants, as compared to 88 percent for the adaptive condition. It should not be surprising that outcomes were less impressive in the as-usual condition, because there was only about a 1 in 3 chance of receiving a consequence for infractions. The primary contribution of adaptive algorithms may be to increase the probability that infractions (and perhaps achievements) are recognized and addressed.
Current Study
The current study replicated the pilot trial in a fully powered randomized experiment, with one important difference in the comparison condition. The pilot trial compared the adaptive algorithm to Drug Court as-usual. However, it was already established from our earlier work that the baseline-matching procedure improved outcomes over Drug Court as-usual. The important remaining question was whether the adaptive algorithm would add incremental utility beyond that attained from the matching procedure. Therefore, the current study compared the effects of the adaptive algorithm to the baseline-matching procedure, rather than to Drug Court as-usual.
Methods
Human Subjects Protections
The study was approved and monitored by the Institutional Review Boards (IRBs) of the Treatment Research Institute and the Delaware State Department of Health & Social Services. A NIH Certificate of Confidentiality was obtained to shield the data from a court-ordered subpoena. All participants provided written informed consent to be in the study, and executed a Health Insurance Portability & Accountability Act (HIPAA) Research Subject Authorization of Confidentiality & Privacy Rights.
Recruitment Procedures
The study was conducted in a misdemeanor Drug Court located in the urban city of Wilmington, DE. Eligibility criteria for this Drug Court require defendants to: (1) be at least 18 years of age; (2) be a resident of or have committed their offense in New Castle County, DE; (3) be charged with a misdemeanor offense including possession or consumption of cannabis, possession of drug paraphernalia, possession of hypodermic syringes, or first-time driving under the influence (DUI); (4) not have a history of a violent offense involving serious injury to a victim or use of a deadly weapon; and (5) meet criteria for substance abuse or dependence as determined by a clinical evaluation performed by treatment professionals working in concert with the Drug Court.
Research staff approached consecutive admissions to the Drug Court from February 2009 through March 2010. Immediately following a group orientation session conducted by treatment staff, a research staff member provided a brief oral description of the study, including participation requirements, payment incentives, confidentiality protections, and the right to refuse or withdraw from the study at any time without negative repercussions. Defendants who indicated a potential interest in the study went through an individualized informed consent procedure before any research data were collected. If a defendant consented to random assignment, the research coordinator informed the judge about the assigned schedule of status hearings, and the judge entered an order making that assignment an official condition of participation in the program. If the defendant declined to be in the study, the judge ordered the routine schedule of status hearings, which was every 4 to 6 weeks.
A total of 335 Drug Court clients were approached by research staff for participation in the study. Of those, 130 (39%) provided informed consent to participate. This consent rate is comparable to our prior studies and was not unexpected given that participants were being asked to potentially attend more frequent court hearings and case-management sessions. Individuals who refused to participate in the study did not differ from those who consented to participate in terms of age, gender, current criminal charges or prior bench warrants (p > .45 in all analyses); however, those who refused to participate were significantly more likely to have been represented by private defense counsel (33% vs. 17%), X2(1) = 9.20, p = .002. Of those who initially consented to participate, three individuals in the adaptive condition (two of whom were determined to be high risk according to study criteria) and two individuals in the baseline-matching condition (one of whom was high risk) withdrew from the study before being exposed to the experimental interventions. This left a final study sample of 125 participants (adaptive n = 62; baseline-matching n = 63).
Brief Description of the Drug Court Program
In this post-plea, pre-adjudication Drug Court, defendants are required to plead guilty to the initial charge(s) and the plea is held in abeyance pending graduation or termination from the program. Graduates have the plea and charges withdrawn and are eligible to have the record expunged if they remain arrest-free for an additional 6 months. If the defendant fails to complete the program, the guilty plea is formally entered as a conviction. Convicted offenders lose their drivers license (where applicable) for a term of 2 years, and are often sentenced to probation with conditions similar to those imposed in Drug Court (e.g., drug abuse counseling and urine monitoring).
The program is scheduled to be a minimum of 4 months (approximately 18 weeks) in length and has no maximum time limit for enrollment. Participants typically require 6 to 10 months to satisfy the requirements for graduation. The requirements for graduation include attending at least 12 weekly group counseling sessions, providing at least 14 consecutive weekly drug-negative urine specimens, remaining arrest free, obeying program rules and procedures, and paying a $200 court fee. The group sessions are psycho-educational in format and cover a standard sequence of topics, including the pharmacology of drug and alcohol use, progression from substance use to dependence, the impact of addiction on the family, treatment options, HIV/AIDS risk reduction, and relapse prevention strategies.
Participants are assigned to a clinical case manager who coordinates any indicated treatment referrals, and the case manager or a court liaison submits monthly progress reports to the judge and appears at all status hearings. Participants provide urine specimens on a random, weekly basis in direct observation of a same-gender treatment staff person. The urine drug screens are performed by an independent certified laboratory using the enzyme multiplied immunoassay technique (EMIT) with gas chromatography/mass spectrometry (GCMS) confirmation of positive results on a six-panel screen for cannabis, alcohol, opiates, amphetamines, cocaine, and phencyclidine (PCP), plus any additional substances believed to be abused by the individual.
The judge is authorized to administer sanctions or therapeutic consequences for inadequate performance in the program. These include verbal reprimands, homework assignments, additional treatment or supervisory obligations, daylong attendance in court as an observer, and community service. The team may also administer rewards for good performance, including verbal praise, token gifts, certificates of recognition, and reductions in participants’ treatment or supervisory obligations.
Adaptive Condition
Participants who were randomly assigned to the adaptive condition (n = 62) were eligible for all of the services that are available in the Drug Court. However, consequences from the bench were scheduled to be imposed according to the adaptive algorithm depicted in Figure 1 and described earlier for the pilot study, unless the judge elected to override a consequence. As in our prior studies, the a priori decision rule for assessing risk level was derived from two dichotomous measures employed on an either/or basis. If participants met DSM-IV diagnostic criteria for APD or had a history of at least one prior drug abuse treatment episode, excluding self-help groups, they were determined to be high risk. If they had neither APD nor a prior drug treatment episode, they were determined to be low risk. The instruments that were used to make these assessments are described below.
Participants were subsequently assessed at monthly intervals to determine how they were progressing in the program, and status hearings or clinical case-management sessions were increased pursuant to the adaptive algorithm. Attendance information and urine drug test results were entered by clinical staff or the drug court manager into a web-based management information system (MIS). The MIS issued an automated alert to the Drug Court staff members whenever a participant in the adaptive condition met criteria for noncompliance or non-responsiveness, and indicated the intended consequence. In addition, the research coordinator for the study alerted Drug Court staff when adaptations were called for. The Drug Court team was free to deliberate about whether to impose a particular consequence, and the judge could override an indicated response.
Baseline-Matching Condition
Participants in the baseline-matching condition (n = 63) were scheduled to attend bi-weekly status hearings if they were determined to be high risk, or as-needed hearings if they were determined to be low risk. The baseline match was performed in the same manner as in the adaptive condition. Subsequently, they were assessed on a monthly basis in the same manner as participants in the adaptive condition; however, the results were not communicated to the Drug Court team. The team responded to the participants’ presentation with no influence or communication from research personnel.
Data Sources
Study participants provided written, informed consent granting the research team access to their treatment records from the Drug Court program. These records included participants’ weekly urine drug-screen results, counseling attendance, and program completion status.
A baseline assessment was administered after obtaining informed consent to research participation. Participants received a $40 money order for completing the entire baseline battery. The battery included the Risk & Needs Triage (RANT™), which has been validated to significantly predict outcomes among drug-involved offenders (Marlowe et al., 2011). The RANT™ contains an antisocial personality disorder diagnostic module (APD-DM). The APD-DM is a 32-item structured interview that assesses DSM-IV (American Psychiatric Association, 2000) diagnostic criteria for APD. A dichotomous diagnosis of APD was used as one of the two risk-assessment variables in our prior studies, and was used in the identical manner in the current study. In previous inter-rater reliability scoring trials, there was greater than 90% exact agreement for dichotomous diagnoses of APD among our research assistants. The RANT™ also contains an item inquiring whether participants attended any prior drug abuse treatment episode, excluding self-help groups. Inter-rater and test-retest reliability for this item were consistently above 90 percent in prior studies.
Finally, participants completed the following questionnaires on a monthly basis during the first 3 months of enrollment. They received a $30 money order for completing each of the monthly assessments. The purpose of the questionnaires was to determine whether the participants might have viewed the use of the adaptive algorithm as being too rigid or mechanistic; or alternatively, whether they might have perceived it as leading to more fair and even-handed decisions by the court.
Perceived Deterrence
The perceived deterrence questionnaire is an eight-item, Likert-type scale that measures respondents’ perceptions of the likelihood that they will receive substantial sanctions for infractions and rewards for achievements in the program. Previous validation studies revealed this measure significantly predicted outcomes in several Drug Court programs (Marlowe, Festinger, Foltz, Lee, & Patapis, 2005b).
Procedural Justice
The procedural justice questionnaire is a four-item, Likert-type scale that measures respondents’ perceptions that they are being treated fairly and respectfully; the degree to which they understand the rules and their rights in the program; and the degree to which they are given a chance to explain their side of an issue prior to the imposition of consequences from the court.
Attitudes towards the judge and program
Two binary items examined participants’ attitudes towards the judge. One item inquired whether participants believed they had a good relationship with the judge, and the second item inquired whether they felt they were being helped by the judge. A single binary item gauged participants’ overall satisfaction with the Drug Court program. The item asked whether or not they were satisfied with the services they received in the Drug Court.
Data Analyses
As a check on randomization, the adaptive and baseline-matching groups were compared on a range of baseline variables, including age, race, gender, employment status, severity of their drug problems, risk level, and criminal history. Any variables that were significantly different between the groups and significantly correlated with outcomes would be statistically controlled for in the outcome analyses.
The primary dependent measure for the study was the percentage of drug-negative urine specimens provided by participants during the first 18 weeks of the program. Drug test results were designated as the primary dependent variable because they are objectively measured and collected longitudinally. Because some participants could graduate within 18 weeks of entry if they readily completed all of the requirements for the program, capping the analyses at 18 weeks ensured there were equivalent data points for all participants. The analyses were performed both by counting missing or invalid urine specimens as missing data, and also by taking a more conservative approach that assumed missing or invalid specimens to be drug-positive. In addition, generalized estimating equations (GEE’s) were used to longitudinally examine the drug test results over the course of the first 18 weeks. The GEE models included terms for group, week, and the group-by-week interaction.
Secondary dependent measures included on-time graduation rates within 18 weeks of entry into the Drug Court, and within 12 months of entry. The average time to case resolution (either through graduation or termination) was examined using a Kaplan-Meier survival analysis. Cases were censored if they were not resolved within the first year post-entry.
Finally, group differences were examined on the questionnaires assessing participants’ attitudes towards the program. These analyses used t-tests for continuous items and chi squares for binary items. To ensure participants were sufficiently exposed to the program to provide reliable and stable responses, the analyses examined each participant’s final monthly assessment.
Results
Participants
The participants were primarily Caucasian (59%) or African American (37%), young adults (M = 24.53 years, SD = 7.67), with a high school education (M = 12.37 years, SD = 1.61). Less than one half of the sample (47%) had been regularly employed during the year prior to their arrest, and the median annual income was approximately $10,000 (range = 0 to $80,000). Nearly two thirds of the sample (64%) tested positive for at least one substance of abuse during the first month of the study. Participants self-reported that their primary substances of abuse were cannabis, heroin or other opiates, cocaine, alcohol, and hallucinogens, respectively.
Participants in the two conditions did not differ by age, race, gender, employment status, severity of their substance abuse problems, or criminal history. However, the groups did differ by risk level, with 13 percent of the adaptive participants being classified as high risk according to the study criteria, compared to 30 percent of those in baseline-matching (p < .05). This difference was accounted for by a larger number of participants in the baseline-matching condition having a prior history of drug abuse treatment. A careful review of the randomization process failed to identify a cause for the imbalance. The randomization process appeared to have been implemented as planned and there was no differential attrition from the groups. Importantly, risk level was not correlated with any outcome measure (p > .30 in all analyses) and the results did not change when risk level was included as a covariate in the analyses. As in our prior studies, the baseline-matching procedure (which was administered to participants in both groups) apparently “neutralized” the influence of risk on outcomes. Therefore, the following analyses did not include risk as a covariate.
Consequences for Noncompliance and Non-Responsiveness
For the sample as whole, 36 percent of the participants met criteria for noncompliance on at least one occasion, and 23 percent met criteria for non-responsiveness. Rates of noncompliance (35% vs. 37%) and non-responsiveness (21% vs. 25%) were equivalent between the two conditions. As intended, participants in the adaptive condition were significantly more likely to receive a consequence for noncompliance than those in the baseline-matching condition, X2(1) = 4.98, p = .03, w = .33. The adaptive participants were more than twice as likely to receive a consequence for noncompliance as those in baseline-matching (64% vs. 30%). There was no significant difference in the likelihood of receiving a consequence for non-responsiveness (46% vs. 56%), X2(1) = .29, p = .59, w = .10.
Urine Drug Test Results
Participants in the adaptive condition provided a significantly greater percentage of drug-negative urine specimens than did participants in the baseline-matching condition. When missing urine specimens were counted as missing data, the adaptive participants were drug-negative an average of 68 percent of the weeks (SD = .39), compared to 49 percent for those in baseline-matching (SD = .43), t(123) = 2.55, p = .01, d = .46. When missing specimens were imputed to be drug-positive, the adaptive participants were drug-negative an average of 61 percent of the weeks (SD = .40), compared to 46 percent (SD = .43) for those in baseline-matching, t(123) = 2.10, p = .04, d = .37.
Longitudinal GEE analyses yielded comparable findings. When missing urine specimens were counted as missing data, the GEE analysis revealed significant main effects for group, X2(1) = 6.84, p = .01, and for time, X2(1) = 18.17, p < .0001. Participants in the adaptive condition were more than twice as likely to be drug-negative as those in baseline-matching (odds ratio [OR] = 2.34; 95% confidence interval [CI] = 1.22–4.64). The likelihood of becoming abstinent increased significantly over successive weeks in the program for participants in both conditions (OR = 1.07, 95% CI = 1.04–1.10). Likewise, when missing urines were imputed to be drug-positive, the GEE analysis revealed a significant group effect, (X2(1) = 7.12, p = .01, and time effect, X2(1) = 4.92, p = .03. Again, participants in the adaptive condition were more than twice as likely to be drug-abstinent as those in baseline-matching (OR = 2.44, 95% CI = 1.27–4.70); and the likelihood of becoming abstinent increased over successive weeks for both groups (OR = 1.03, 95% CI = 1.01–1.05). Figure 2 depicts the proportions of drug-negative urine samples for the two groups during the first 18 weeks, imputing missing samples as drug-positive.
Figure 2.
Percentage of participants providing drug-negative urine specimens during the first 18 weeks of enrollment. Missing and invalid urine samples were imputed to be drug-positive. Group effect: p = .01, odds ratio [OR] = 2.44. Time effect: p = .03, OR = 1.03.
Graduation Rates
Approximately 31 percent of the participants in the adaptive condition graduated on time within 18 weeks of entry into the program, compared to 23 percent of those in baseline-matching. This trend did not reach statistical significance, X2(1) = .83, p = .36, w = .08. Approximately 68 percent of participants in the adaptive condition graduated within 12 months, compared to 67 percent of those in baseline-matching. This negligible difference did not approach significance, X2(1) = .02, p = .90, w = .01.
Time to Case Resolution
Approximately 85 percent of the cases in the adaptive condition were resolved (favorably or unfavorably) within the first 12 months after entry, compared to 87 percent of those in baseline-matching. The mean survival time to case resolution was not significantly different between the groups, X2(1) = .05, p = .81, hazard ratio [HR] = 1.05, 95% CI = 0.72–1.52. The average survival interval was 193.61 days (SE = 11.77) for participants in the adaptive condition, compared to 200.13 days (SE = 12.13) for those in baseline-matching.
Perceptions of the Program
Coefficient alpha was 0.86 for the perceived deterrence questionnaire and 0.78 for the procedural justice questionnaire. There were no statistically significant differences between the adaptive and baseline-matching groups on any of the self-report items or scales. There was a non-significant trend (p = .10) favoring greater perceptions of procedural justice in the adaptive condition; however, measures of perceived deterrence, attitudes towards the judge, and satisfaction with the Drug Court services did not approach significance. Perceptions of the program were generally favorable in both conditions, with a substantial proportion of all participants reporting high levels of perceived procedural justice and favorable attitudes towards the judge and the Drug Court services as a whole.
Discussion
This study experimentally examined the effects of an adaptive program in a misdemeanor Drug Court. Previous research found that outcomes were significantly improved by matching participants to schedules of judicial status hearings based on their assessed criminological risk profile (Festinger et al., 2002; Marlowe et al., 2006, 2007). The current study determined whether additional incremental utility could be gained by periodically adjusting the schedule of judicial status hearings and clinical case-management sessions in response to participants’ ensuing performance in the program.
Results confirmed that participants randomly assigned to the adaptive condition were significantly more likely to provide drug-negative urine samples during the first 18 weeks of the program than those assigned to baseline-matching only. The odds of being drug-negative were more than twice the magnitude for participants in the adaptive condition than for those in baseline-matching (OR = 2.34 when missing urine specimens were treated as missing data; OR = 2.44 when missing specimens were imputed to be drug-positive).
The improvement in drug abstinence rates appears to have been attributable to providing more intensive supervision of recalcitrant offenders, as opposed to administering more intensive and individualized clinical services. Participants in the adaptive condition were more than twice as likely as those in baseline-matching to receive increased judicial supervision as a consequence for noncompliance in the program (64% vs. 30%, p = .03); however, there was no difference in the likelihood of receiving increased clinical case management as a consequence for non-responsiveness (p = .59). This suggests that the mechanism of action for the adaptive algorithm may have stemmed from holding participants more accountable for meeting their attendance obligations in the program, rather than enhancing clinical services in response to unmet treatment needs.
Because most commonly used risk-assessment tools rely, at least in part, on offenders’ self-reports to determine risk levels, it may not take long for the more savvy individuals to discern the “right” answers that will trigger lower levels of judicial supervision. If their subsequent behavior belies the accuracy of the assessment results, it is important to recognize the error and alter the conditions of supervision accordingly. It appears that the adaptive algorithm may have assisted staff to more readily identify mismatches and adjust the program requirements to meet the participants’ demonstrated needs.
Criminal justice professionals and substance abuse treatment professionals may be capable of making comparable adjustments on their own initiative. However, in practice, many of these professionals may be too busy, distracted or inadequately skilled to respond efficiently to distortions by offenders or rapidly changing conditions in the offenders’ lives. In the current study, consequences for noncompliance were administered in less than one third of the cases for participants in the baseline-matching condition, leaving the lion’s share of the infractions undetected or unaddressed. Compliance with correctional supervision is unlikely to be optimal if there is less than a 1 in 3 chance of receiving a consequence for failing to show up for treatment sessions or drug testing. A primary contribution of adaptive algorithms may be to increase the probability that such infractions (and perhaps achievements) are recognized and responded to by staff. This might allow Drug Courts to supervise a larger number of participants with lesser concerns that some offenders may “slip through the cracks” and continue noncompliant behavior with relative impunity.
There was no evidence from the current study that employing a structured algorithm hindered participants’ perceptions of procedural fairness in the program, or their attitudes towards the judge or the program as a whole. If anything, there was a non-significant trend (p = .10) favoring greater perceptions of procedural fairness by participants in the adaptive condition. It is possible that following a pre-specified protocol might reduce the likelihood that some participants will receive discrepant consequences for comparable infractions, and thus reduce potential perceptions of bias or inequality. Further research is needed to more closely gauge participants’ perceptions of adaptive algorithms as compared to individualized discretion in the imposition of consequences from the bench.
Although there were substantial improvements in drug-abstinence rates for the adaptive program, there were no significant differences in graduation rates or in the average length of time to case resolution. On one hand, this discrepancy could suggest that the adaptive algorithm impacted only substance use patterns, and did not affect other outcomes, such as the payment of fines or obedience to program rules. Because the contingencies in the adaptive algorithm focused only on session attendance and drug test results, they may have had minimal effects on other behavioral outcomes. Additional efforts are needed to extend the reach of the adaptive algorithm to influence other relevant behaviors.
An alternative explanation for the apparent discrepancy between drug test results and graduation rates could be that decisions concerning graduation or termination were not assiduously based on objective indicia of success in treatment. If participants in the adaptive condition provided nearly twice the number of negative drug tests during the first 18 weeks, it is difficult to understand why they graduated at an equivalent rate during the same 18-week period. Given that urine test results are one of the primary (if not the primary) criteria for graduation from a Drug Court, one might have expected the adaptive participants to meet the requirements for graduation more readily. Perhaps graduation decisions were influenced by other subjective factors, such as participants’ demeanor or the arguments of defense counsel, which may or may not predict continued desistence from crime and drug abuse. Future assessments of the current cohort will provide additional insights into the effects of the adaptive program on objectively measured re-arrest rates.
Limitations
There are several important limitations to this study that must be borne in mind when interpreting the results. The study was conducted in a single misdemeanor Drug Court in an urban environment, and it is unknown whether the results will generalize to other offender populations (e.g., felony drug offenders, juvenile offenders, or mentally ill offenders) or to other geographic regions (e.g., rural communities). As was noted earlier, the effects of the baseline-matching procedure were replicated in felony and misdemeanor Drug Courts located in urban and rural communities, and similar replication studies are needed for the adaptive program as well.
The consent rate for the study was 39 percent, which could have reduced the representativeness of the sample. Defendants who refused to participate in the study were significantly more likely to have been represented by private defense counsel. This might suggest that they had greater financial resources. Moreover, outcomes might have been systematically influenced by the relative expertise of private defense counsel or their familiarity with Drug Court operations. Individuals who refused participation may also have differed on variables that were not measured in this study. For example, defendants who were relatively less motivated or more seriously drug-addicted might have been more likely to refuse participation. As a result, the study sample might not have adequately reflected the characteristics of the target population of the Drug Court.
The groups differed by risk level, with 13 percent of the adaptive participants meeting study criteria for being high risk, compared to 30 percent of those in baseline-matching (p < .05). Risk level was not correlated with any outcome measure, and the results did not change when risk level was included as a covariate in the analyses. This indicates that baseline differences in risk level were not responsible for the differences in outcomes. As noted previously, the baseline-matching procedure, which was administered to participants in both groups, apparently leveled the influence of risk on outcomes. Nevertheless, because the interventions were specifically targeted to participants’ risk level, this imbalance between cells could have impacted the results in unanticipated ways. For this reason, current studies are employing an urn-randomization procedure to ensure risk level is equivalently distributed between conditions.
The current analyses examined outcomes within the first year after entry into the Drug Court, when many of the participants had only recently graduated or were still enrolled in treatment. Future analyses will examine outcomes over longer follow-up intervals, when participants are no longer under the jurisdiction and control of the Drug Court program.
Although the perceived deterrence scale has been validated in Drug Courts (Marlowe et al., 2005b), the other attitudinal questionnaires were created for purposes of this study and have not been examined for validity or reliability. Therefore, lesser confidence may be placed in conclusions concerning whether the adaptive algorithm influenced perceptions of procedural fairness or satisfaction with the program. More research using validated instruments is needed to confidently conclude whether and how adaptive algorithms might influence offenders’ perceptions of justice and fairness in Drug Courts.
Finally, there is nothing sacrosanct about the adaptive algorithm employed in this study. As described earlier, this algorithm was developed through a collaborative process between the Drug Court team and research staff. There are undoubtedly numerous ways to improve upon the algorithm to elicit more consistent and sustained effects. For example, although there may be a logical rationale for distinguishing between noncompliance and non-responsiveness, it may be difficult, in practice, to reliably separate out these two issues. Some participants may fail to provide urine specimens for the very reason that they expect them to be drug-positive. This could blur the distinction between noncompliance and non-responsiveness, and make it difficult to determine whether an individual is engaging in willful disobedience as opposed to manifesting clinical dysfunction.
The adaptive algorithm made no effort to standardize what transpired during the court hearings or case-management sessions. Research, to date, suggests that simply increasing the dosage of services, where needed, may be sufficient to elicit improved outcomes. This is not to suggest, however, that training judges or case managers on interactional strategies (e.g., motivational interviewing techniques) is unlikely to elicit greater benefits. For example, research suggests that hostility or a lack of readiness for change may predict negative treatment outcomes among drug offenders (e.g., Hiller, Knight, Saumi, & Simpson, 2006). It may be useful to design adaptive counseling strategies to address such attitudinal risk factors.
Finally, the adaptive algorithm did not ratchet services downward in response to good performance in the program. The issue of scaling down services relates to the best way to move offenders along a continuum of care, from an intensive index treatment episode to less intensive continuing aftercare. Failing to address this critical transition could explain why the effects of the adaptive algorithm might not have been sustained beyond the first several months. Future research should evaluate adaptive algorithms that taper down the provision of services and prepare offenders for long-term maintenance of drug abstinence and desistence from crime.
Summary
The results of this controlled experiment confirmed that adaptive programming has the potential to increase drug abstinence among misdemeanor Drug Court participants. More research is needed to replicate the findings and improve the adaptive algorithm so that it may elicit longer-term effects on a wider range of outcomes. Although it is premature to characterize adaptive programming as a best practice or evidence-based practice for drug-abusing offenders, the promising evidence emerging from this experiment is sufficient to justify further examination of adaptive interventions among offender populations.
Table 1.
Outcomes by condition.
Adaptive (n = 62) Mean (SD) or % |
Baseline-Matching (n = 63) Mean (SD) or % |
p-value | Effect Size d or w |
|
---|---|---|---|---|
Received consequence for noncompliance | 64% | 30% | .03 | .33 |
Received consequence for non-responsiveness | 46% | 56% | .59 | .10 |
Percent weeks abstinent (missed urines = missing data) | 0.68 (0.39) | 0.49 (0.43) | .01 | .46 |
Percent weeks abstinent (missed urines = drug-positive) | 0.61 (0.40) | 0.46 (0.43) | .04 | .37 |
Graduated within 18 weeks | 31% | 23% | .36 | .08 |
Graduated within 12 months | 68% | 67% | .90 | .01 |
Days to case resolution mean (SE) | 193.61 (11.77) | 200.13 (12.13) | .81 | |
Perceived Deterrence Scale (range = 0 to 24) | 17.86 (5.00) | 18.85 (4.74) | .28 | .20 |
Procedural Justice Scale (range = 0 to 12) | 10.86 (1.54) | 10.30 (2.15) | .10 | .30 |
Helped by judge | 73% | 73% | .98 | .003 |
Good relationship with judge | 62% | 75% | .16 | .14 |
Satisfied with Drug Court services | 86% | 89% | .70 | .03 |
Notes: Noncompliance = two or more unexcused absences from counseling sessions within one month, or two or more unexcused failures to provide a valid urine specimen within one month. Non-responsiveness = two or more positive urine drug tests within one month.
Acknowledgments
This research was supported by grant #R01-DA-013096 from the National Institute on Drug Abuse (NIDA). The views expressed are those of the authors and do not necessarily reflect the views of NIDA. The authors gratefully acknowledge the continuing collaboration of the New Castle County Court of Common Pleas, Delaware State Attorney General’s Office, Delaware Office of the Public Defender, Delaware Association of Criminal Defense Lawyers, Delaware State Division of Substance Abuse & Mental Health, Treatment Access Center, and Brandywine Counseling, Inc.
References
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4. Washington, DC: American Psychiatric Press; 2000. text rev. [Google Scholar]
- Andrews DA, Bonta J. The Psychology of Criminal Conduct. 5. New Providence, NJ: LexisNexis; 2010. [Google Scholar]
- Aos S, Miller M, Drake E. Evidence-based public policy options to reduce future prison construction, criminal justice costs, and crime rates. Olympia, WA: Washington State Institute for Public Policy; 2006. [Google Scholar]
- Bennett T, Holloway K, Farrington D. The statistical association between drug misuse and crime: A meta-analysis. Aggression & Violent Behavior. 2008;13:107–118. [Google Scholar]
- Bhati AS, Roman JK, Chalfin A. To treat or not to treat: Evidence on the prospects of expanding treatment to drug-involved offenders. Washington, DC: The Urban Institute; 2008. [Google Scholar]
- Chandler RK, Fletcher BW, Volkow ND. Treating drug abuse and addiction in the criminal justice system: Improving public health and safety. JAMA. 2009;301:183–190. doi: 10.1001/jama.2008.976. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins LM, Murphy SA, Bierman KA. A conceptual framework for adaptive preventive interventions. Prevention Science. 2004;5:185–196. doi: 10.1023/b:prev.0000037641.26017.00. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeMatteo DS, Marlowe DB, Festinger DS. Secondary prevention services for clients who are low risk in drug court: A conceptual model. Crime & Delinquency. 2006;52:114–134. doi: 10.1177/0011128705281746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Downey PM, Roman JK. A Bayesian meta-analysis of drug court cost-effectiveness. Washington DC: The Urban Institute; 2010. [Google Scholar]
- Farole DJ, Puffett N, Rempel M, Byrne F. Can innovation be institutionalized? Problem-solving in mainstream courts. New York: Center for Court Innovation; 2004. [Google Scholar]
- Fazel S, Bains P, Doll H. Substance abuse and dependence in prisoners: A systematic review. Addiction. 2006;101:181–191. doi: 10.1111/j.1360-0443.2006.01316.x. [DOI] [PubMed] [Google Scholar]
- Festinger DS, DeMatteo DS, Marlowe DB, Lee PA. Expungement of arrest records in drug court: Do clients know what they’re missing? Drug Court Review. 2005;5:1–21. [Google Scholar]
- Festinger DS, Marlowe DB, Lee PA, Kirby KC, Bovasso G, McLellan AT. Status hearings in drug court: When more is less and less is more. Drug & Alcohol Dependence. 2002;68:151–157. doi: 10.1016/s0376-8716(02)00187-4. [DOI] [PubMed] [Google Scholar]
- Hiller ML, Knight K, Saum CA, Simpson DD. Social functioning, treatment dropout, and recidivism of probationers mandated to a modified therapeutic community. Criminal Justice & Behavior. 2006;33:738–759. [Google Scholar]
- Karberg JC, James DJ. Substance dependence, abuse, and treatment of jail inmates, 2002 [NCJ 209588] Washington, DC: Bureau of Justice Statistics, U.S. Dept. of Justice; 2005. [Google Scholar]
- Latimer J, Morton-Bourgon K, Chretien J. A meta-analytic examination of drug treatment courts: Do they reduce recidivism? Canada Dept. of Justice, Research & Statistics Division; 2006. [Google Scholar]
- Lowenkamp CT, Holsinger AM, Latessa EJ. Are drug courts effective? A meta-analytic review. Journal of Community Corrections. 2005 Fall;:5–28. [Google Scholar]
- Marlowe DB. Effective strategies for intervening with drug abusing offenders. Villanova Law Review. 2002;47:989–1025. [Google Scholar]
- Marlowe DB. Application of sanctions. In: Hardin C, Kushner JN, editors. Quality improvement for drug courts: Evidence-based practices. Alexandria, VA: National Drug Court Institute; 2008. pp. 107–114. [Monograph Series No. 9] [Google Scholar]
- Marlowe DB, Festinger DS, Arabia PL, Dugosh KL, Benasutti KM, Croft JR. Adaptive interventions may optimize outcomes in drug courts: A pilot study. Current Psychiatry Reports. 2009;11:370–376. doi: 10.1007/s11920-009-0056-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Arabia PL, Dugosh KL, Benasutti KM, Croft JR, McKay JR. Adaptive interventions in drug court: A pilot experiment. Criminal Justice Review. 2008;33:343–360. doi: 10.1177/0734016808320325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Dugosh KL, Caron A, Podkopacz MR, Clements NT. Targeting dispositions for drug-involved offenders: A field trial of the Risk and Needs Triage (RANT) Journal of Criminal Justice. 2011;39:253–260. [Google Scholar]
- Marlowe DB, Festinger DS, Dugosh KL, Lee PA. Are judicial status hearings a “key component” of drug court? Six and twelve month outcomes. Drug & Alcohol Dependence. 2005a;79:145–155. doi: 10.1016/j.drugalcdep.2005.01.019. [DOI] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Dugosh KL, Lee PA, Benasutti KM. Adapting judicial supervision to the risk level of drug offenders: Discharge and six-month outcomes from a prospective matching study. Drug & Alcohol Dependence. 2007;88S:4–13. doi: 10.1016/j.drugalcdep.2006.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Foltz C, Lee PA, Patapis NS. Perceived deterrence and outcomes in drug court. Behavioral Sciences & the Law. 2005b;23:183–198. doi: 10.1002/bsl.636. [DOI] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Lee PA. The role of judicial status hearings in drug court. In: Knight K, Farabee D, editors. Treating addicted offenders: A continuum of effective practices. chap 11. Kingston, NJ: Civic Research Institute; 2004a. [Google Scholar]
- Marlowe DB, Festinger DS, Lee PA. The judge is a key component of drug court. Drug Court Review. 2004b;4(2):1–34. [Google Scholar]
- Marlowe DB, Festinger DS, Lee PA, Dugosh KL, Benasutti KM. Matching judicial supervision to clients’ risk status in drug court. Crime & Delinquency. 2006;52:52–76. doi: 10.1177/0011128705281746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marlowe DB, Festinger DS, Lee PA, Schepise MM, Hazzard JER, Merrill JC, Mulvaney FD, McLellan AT. Are judicial status hearings a key component of drug court? During-treatment data from a randomized trial. Criminal Justice & Behavior. 2003b;30:141–162. [Google Scholar]
- Marlowe DB, Patapis NS, DeMatteo DS. Amenability to treatment of drug offenders. Federal Probation. 2003a;67:40–46. [Google Scholar]
- Marlowe DB, Wong CJ. Contingency management in adult criminal drug courts. In: Higgins ST, Silverman K, Heil SH, editors. Contingency management in substance abuse treatment. New York: Guilford Press; 2008. pp. 334–354. [Google Scholar]
- McKay JR. Treating substance use disorders with adaptive continuing care. Washington DC: American Psychological Association; 2009. [Google Scholar]
- Murphy SA, Lynch KG, McKay JR, Oslin D, TenHave T. Developing adaptive treatment strategies in substance abuse research. Drug & Alcohol Dependence. 2007;88(2):S24–S30. doi: 10.1016/j.drugalcdep.2006.09.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Center on Addiction & Substance Abuse. Behind bars II: Substance abuse and America’s prison population. New York: Author; 2010. [Google Scholar]
- Shaffer DK. Looking inside the black box of drug courts: A meta-analytic review. Justice Quarterly. 2010;28:493–521. [Google Scholar]
- Taxman FS, Marlowe DB, editors. Risk, needs, responsivity: In action or inaction? [Special Issue] Crime & Delinquency. 2006;52(1) doi: 10.1177/0011128705281754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- University of California, Los Angeles. UCLA Integrated Substance Abuse Programs. 2007. Evaluation of the Substance Abuse and Crime Prevention Act: Final Report. [Google Scholar]
- Wilson DB, Mitchell O, MacKenzie DL. A systematic review of drug court effects on recidivism. Journal of Experimental Criminology. 2006;2:459–487. [Google Scholar]
- Wormith JS, Goldstone CS. The clinical and statistical prediction of recidivism. Criminal Justice & Behavior. 1984;11:3–34. [Google Scholar]
- Zhang Z. Drug and alcohol use and related matters among arrestees. Bethesda, MD: National Opinion Research Center & National Institute of Justice, Arrestee Drug Abuse Monitoring Program; 2003. at http://www.ncjrs.gov/nij/adam/ADAM2003.pdf. [Google Scholar]