Skip to main content
Sage Choice logoLink to Sage Choice
. 2017 Jul 13;64(8):1001–1032. doi: 10.1177/0011128717719662

Selection Processes in Prison-Based Treatment Referrals: A Street-Level Bureaucracy Perspective

A Q Bosma 1,, M J J Kunst 1, A J E Dirkzwager 2, P Nieuwbeerta 1
PMCID: PMC5971368  PMID: 29880980

Abstract

Studies indicated that detainees are not always allocated to treatment programs based on official guidelines. Street-level bureaucracy theory suggests that this is because government employees do not always perform policies as prescribed. This study aimed to assess whether this also applies to the allocation of offenders to treatment in Dutch penitentiary institutions, and aimed to determine which factors influenced this. The proposed questions were addressed by studying a group of 541 male prisoners who participated in the Dutch prison-based Prevention of Recidivism program. Results showed that official guidelines were, in most cases, not leading when referring detainees to programs. Instead, treatment referrals were influenced by a broad range of risk factors, as well as the length of an offender’s sentence.

Keywords: prison-based treatment, treatment allocation, risk–need–responsivity, street-level bureaucracy

Introduction

Recidivism rates among ex-detainees are high. Studies have shown rearrest rates of about 60% within 3 years after release and reincarceration rates as high as 50% within that same period of time (Hughes & Wilson, 2002; Social Exclusion Unit [SEU], 2002). In the Netherlands, research has shown that within 6 years, over 70% of released prisoners were reconvicted and almost 50% were again incarcerated (Wartna et al., 2010). Within this context, nowadays, an increasing amount of attention is being paid to what the prison system can do to prepare detainees for reentry into society and to reduce reoffending after release. To achieve this, many Western countries have developed and implemented prison-based rehabilitation programs that aim to lower chances of future criminal behavior (Bonta & Andrews, 2007; Hannah-Moffat, 2005; Jolley & Kerbs, 2010).

Correctional rehabilitation programs are generally based on the central principles of effective treatment, represented in the risk–need–responsivity [RNR] model of crime prevention and correctional rehabilitation (Andrews, Bonta, & Hoge, 1990). This model argues that treatment can be effective in reducing reoffending rates if it is matched to the characteristics of individual offenders. The model specifies who should be treated (high-risk offenders), what should be treated (criminogenic needs; factors that were shown related to future reoffending), and gives direction to how offenders should be treated (in line with, for example, their motivation, intelligence, and learning style; Andrews & Bonta, 2010; Andrews et al., 1990; Lowenkamp & Latessa, 2005). Research has shown that treatment effectiveness increases if more principles are met (see, for example, Andrews et al., 1990; Cullen & Gendreau, 2001; Gendreau, 1996; Lipsey & Cullen, 2007; Lowenkamp, Latessa, & Holsinger, 2006; Lowenkamp, Latessa, & Smith, 2006).

As suggested by the RNR model, correctional treatment can only effectively reduce future reoffending, if offenders are allocated to a program that is in line with their risk for recidivism and criminogenic needs. Latessa, Cullen, and Gendreau (2002) have compared the issue of allocating offenders to treatment resources to a hospital or doctor’s office: The first step toward delivering effective treatment is diagnosing a patient’s condition and its severity. If a diagnosis is absent, treatment will have no clear foundation and medicine would be a “lottery” in which a patient can only hope that he or she was referred to proper treatment (Latessa et al., 2002). Correctional treatment allocation works in a similar way. Effective treatment programs rely on a proper assessment of risk for future criminal behavior and criminogenic needs (Latessa et al., 2002).

To assess risk and needs, risk assessment tools were developed. Contemporary risk assessment (Andrews, Bonta, & Wormith, 2004, 2006; Bonta & Andrews, 2007) assess static- (such as criminal history) and dynamic factors (such as substance abuse problems), based on which a risk level is determined. This also gives insight in the type of criminogenic needs that need to be targeted. Unfortunately, previous work has identified three issues regarding risk assessment. First, it appears that risk assessment is not always applied (Latessa et al., 2002; Taxman, Perdoni, & Harrison, 2007). For example, a national study conducted in the United States has found that only 34.2% of correctional agencies use a standardized risk assessment instrument to place offenders in substance abuse treatment (Taxman et al., 2007). Second, risk assessment is often conducted using unstandardized, nonvalidated, poorly designed, and/or outdated instruments (see, for example, Matthews, Hubbard, & Latessa, 2001; Latessa et al., 2002; Taxman & Marlowe, 2006). And third, if standardized and validated risk assessment instruments (such as a fourth generation tool; see Andrews et al., 2004, 2006) are used, outcomes are frequently ignored (Latessa et al., 2002; Taxman & Bouffard, 2000). Taken all into consideration, some scholars have proclaimed a one-size-fits-all approach to referring offenders to services (Taxman & Marlowe, 2006).

This supposed one-size-fits-all approach, which goes against existing policies based on knowledge on effectiveness as demonstrated by previous research, is not unique for correctional rehabilitation programming. In fact, policies are often not being performed in practice, as they were designed, caused by the actions of public service employees in many (governmental) organizations; a phenomenon often referred to as street-level bureaucracy (Lipsky, 1980). This study aims to address if this is also the case in a prison-based rehabilitation program applied in the Netherlands.

Prison-Based Rehabilitation in the Netherlands

In the Netherlands, rehabilitation efforts were embedded within the Prevention of Recidivism program: a prison-based rehabilitation program designed for detainees with a prison sentence of at least 4 months, implemented nationwide in 2007. In line with the RNR model, the Prevention of Recidivism program aims to reduce reoffending rates among participants by focusing on two focal points: (a) assessing risk for recidivism and criminogenic needs by use of a standardized, validated risk assessment instrument, and (b) applying criminogenic need-specific treatment programs in line with risk assessment outcomes (Van der Linden, 2004).

To attain the first objective, assessment of risk for reoffending and criminogenic needs, the Dutch-language Recidivism Assessment Scales (RISc) was developed, an instrument based on and highly comparable to the British Offender Assessment System (OASys; Howard, Clark, & Garnham, 2003). The RISc was designed to (a) assess an offender’s likelihood of recidivism (defined as a new conviction); (b) identify and classify offending-related needs on 12 criminogenic risk domains, namely, (b-a) offending history and (b-b) current offense and pattern of offenses; (b-c) accommodation; (b-d) education, work, and training; (b-e) financial management and income; (b-f) relationships with partner, family, and relatives; (b-g) relationships with friends and acquaintances; (b-h) drug misuse; (b-i) alcohol misuse; (b-j) emotional well-being; (b-k) thinking and behavior; and (b-l) attitudes and orientation; (c) assess an offender’s responsivity to treatment; and (d) indicate the need for further risk evaluation (Adviesbureau van Montfoort & Reclassering Nederland [AVM & RO], 2004). Studies have demonstrated the intraclass reliability, internal consistency, and predictive validity of the RISc to be satisfactory (Van der Knaap, Leenarts, Born, & Oosterveld, 2012).

In light of the second objective, criminogenic need-specific treatment modules were developed and implemented. To ensure program quality, implemented programs had to be accredited by an accreditation committee that was set up by the Dutch Ministry of Justice and Safety. This committee assessed the potential effectiveness of behavioral interventions based on criteria derived from the what works and RNR literature (such as an adherence to risk and need factors, and treatment integrity). The two main treatment programs that were carried out within the scope of the Prevention of Recidivism program are Cognitive Skills training, to improve the cognitive skills necessary to function in society, and Lifestyle training, to help offenders cope with addiction to drugs or alcohol. Other available trainings are Job Skill training and a Dutch version of the Aggression Replacement Training. However, research has shown that these were only applied sparsely (Bosma, Kunst, & Nieuwbeerta, 2013).

Program manuals prescribe that risk assessment outcomes determine qualification for each correctional program. For example, a moderate to high overall risk to reoffend (evidenced by a risk assessment score of at least 32) and cognitive deficits (evidenced by a weighted score on the risk assessment scale, thinking and behavior, of at least 4) qualifies an offender for cognitive skills training (Ministry of Justice, 2007), while substance- and or gambling-abuse problems (evidenced by a score on the risk assessment scales, drug misuse, of at least 3, and/or alcohol misuse of at least 2, and or financial management and income of at least 5, with a minimal score of 2 on Item 5.4) qualifies an offender for lifestyle training (SVG Verslavingsreclassering, 2009). If an offender has no criminogenic needs, offenders can enter the Prevention of Recidivism program without having to engage in specific treatment modules.

Although the guidelines for treatment referrals may be clear, in practice, such guidelines are not always carried out as prescribed. This was exemplified by previous studies, indicating that risk assessment instruments aren’t always used to allocate offenders to treatment (see, for example, Latessa et al., 2002). If risk assessment instruments were leading to refer offenders to trratment in the Netherlands, was assessed by the current study.

Theoretical Considerations

Several factors can contribute to policies not being performed in practice, as they were prescribed. In Street-level Bureaucracy: Dilemmas of Individuals in Public Services, Lipsky (1980) sets forth a bottom-up approach to understanding public policy implementation by arguing that a successful implementation of public policy is not solely determined by the quality of policy measures, but instead is for a large part dependent on the actions of those who carry out government policy, so-called frontline workers, or street-level bureaucrats. To understand how street-level bureaucrats have such a large influence on policy implementation, there are five characteristics that need mentioning (see Maynard-Moody & Portillo, 2010). First, street-level bureaucrats are public service employees who are de facto frontline workers, meaning that they often function at the bottom of the organizational hierarchy (Lipsky, 1980). Traditional examples of frontline workers are teachers and social workers. Other officials such as correctional officers (Guy, Newman, & Mastracci, 2008) can, however, also be considered street-level bureaucrats. Second, street-level bureaucrats often interact directly (face-to-face) with clients and citizens (Lipsky, 1980). In many cases, these individuals are nonvoluntary clients (such as a citizen stopped by a police officer), who did not choose the service of the specific governmental agency and cannot seek alternative services elsewhere (Maynard-Moody & Portillo, 2010). A third key-component of frontline workers relates to the fact that, although their work can be considered highly scripted, public service employees are allowed to vary in the extent to which they impose the rules and laws assigned to them. This discretion, according to Lipsky (1980), is a result of the complex decisions that street-level bureaucrats have to make in which they have to interpret and apply general policies in specific situations (Lipsky, 1980, 2010); Fourth, related to this discretion, they also have considerable autonomy in making decisions, and often their activities are unsupervised. For example, a teacher is almost always alone in a classroom, with little to no direct management supervision. A fifth and final key characteristic of frontline workers is that, on paper, they are never considered part of the policy process, when in fact they are perhaps the ultimate policy makers (Weatherly, 1979); they are the final policy makers, and perhaps have the greatest influence (Maynard-Moody & Portillo, 2010).

The work of street-level bureaucrats can be difficult and demanding; they often have to deal with working under great time pressure, with limited resources, and have to cope with expectations from both clients and their employer. To be able to do their job as efficiently as possible, it is argued that public service employees develop coping strategies. In coping, a frontline worker basically accepts work pressure as a given and tries to make the best of it (Lipsky, 1980), usually by trying to decrease demands for services. Scholars have distinguished various types of coping strategies such as making standardized or routine decisions for groups of clients (routinizing; which is often based on stereotypes), redefining tasks and priorities in which priority is given to decisions that involve easier and manageable clients and cases (creaming); a frontline worker may also try to make services less attractive for clients (rationing), for example, by creating longer waiting times (Ellis, 2011; Lehmann Nielsen, 2006; Lipsky, 1980, 2010; Tummers, Bekkers, Vink, & Musheno, 2015). Coping frequently results in deviating from prescribed standards, biases the implementation of public policy, and often negatively influences policy goals (Winter, 2002). Lipsky (1980, p. xvii) refers to this phenomenon as “a gap between policy as written, and policy as performed.” As put in Lipsky’s words, “. . . the decisions of street-level bureaucrats, the routines they establish, and the devices they invent to cope with uncertainties and work pressure, effectively become the public policies they carry out.” (Lipsky, 1980, p. xii).

Although perhaps never before considered as such, prison staff members who make decisions about the allocation of offenders to treatment can be deemed to function as street-level bureaucrats. That is to say, prison employees who make these decisions (a) are operational staff members, (b) are in direct contact with prisoners (a nonvoluntary client), (c) make the decisions with a considerable amount of discretion, and (d) have relative autonomy; consequently, they can be considered (e) the ultimate (as final) policy makers in Dutch prison-based treatment implementation.

As prison staff members who decide upon the referral of offenders to treatment are considered street-level bureaucrats, they are expected to act accordingly. First, it is therefore expected that prison staff members apply considerable discretion when making treatment referral decisions, resulting in treatment referrals not (fully) in line with risk and need assessment outcomes. This may result in limited access to care for a (perhaps selective) group of offenders. Second, based on street-level bureaucracy theory, it is hypothesized that prison staff members, caused by (a) a gap between resources and demands and (b) as a result of a number of coping mechanisms, do not always allocate offenders to appropriate treatment programs (i.e., treatment based on their risk and need assessment scores). Instead, as theory predicts, prison staff members are expected to resort to standardized referrals of offenders to programs, with priority given to either the most manageable offenders who are expected to remain and actively engage in treatment, or to those who are considered to be most in need of treatment, and for whom the best outcomes are expected. As at the moment of making treatment referral decisions prison staff members do not have access to in-depth information regarding, for example, an offender’s criminal history, or court documentation on every aspect of their current offense (Inspectorate of Security and Justice, 2010), they typically have to rely on risk assessment outcomes to assess an offender’s condition. To make attributions on who should (or should not) be referred to treatment, prison staff members are expected to rely on the broad range of risk assessment outcomes, as assessed by the Recidivism Assessment Scales (scores regarding the following domains: offending history; current offense and pattern of offenses; accommodation; education, work, and training; financial management and income; relationships with partner and relatives; relationships with friends and other acquaintances; drug misuse; alcohol misuse; emotional well-being; thinking and behavior; and attitudes/orientation), with a more serious (or severe) risk and need assessment outcomes leading to either less or more treatment referrals. In addition, in line with street-level bureaucracy theory (Lipsky, 1980), nonconformity with prescribed policies is expected to increase if there is a larger gap between the earlier mentioned resources and demands. Therefore, it is expected that certain organizational circumstances influence treatment referral decision-making processes. First, concerning the expected sentence length, it is hypothesized that a longer prison sentence will make it easier to get an offender enrolled in treatment. As research has shown that turnaround times for treatment programs can be extensive (Inspectorate of Security and Justice, 2010), it may be expected that a long expected sentence leads to an increase in treatment referrals. Second, it may be hypothesized that overcrowding and staff shortages will serve as an organizational constraint, limiting time and recourses to be spent on an individual detainee, thereby negatively influencing treatment referrals. It may therefore be expected that prison crowding—the number of detainees imprisoned versus the maximum prison occupation—as well as staff detainee ratios—the number of detainees versus the number of rehabilitation staff members—will influence treatment referrals. Finally, not every treatment program is on offer in every prison, so sometimes, referring an offender to a treatment program means the offender has to be relocated to another prison. It could be the case that this will be viewed as a disadvantage, decreasing the number of treatment referrals. Consequently, it may be hypothesized that treatment availability will positively influence treatment referrals.

In summary, based on street-level bureaucracy theory (Lipsky, 1980), it is hypothesized that (a) prison staff members deviate from prescribed policies in referring offenders to treatment programs. In doing so, it is expected that (b) they are influenced by offenders’ risk and need assessment outcomes and a set of relevant organizational circumstances.

Previous Studies

Street-level bureaucracy theory was subjected to an immense body of empirical studies, which have found substantial empirical evidence for its applicability (for a summary, see Brodkin, 2012; Maynard-Moody & Portillo, 2010; Tummers et al., 2015), among different populations, including (but not limited to) teachers (Weatherley, 1979), social workers (Ellis, 2007), police officers (Brown, 1981; Mastrofski, Worden, & Snipes, 1995; Maynard-Moody & Musheno, 2003), and judges (Cowan & Hitchings, 2007). These studies often find that formal policy is in most cases not identical to the policy as produced, or as stated by Brodkin (2012), “What you see may not be what you get” (p. 943). Previous work has also focused on some of the key concepts central in Lipsky’s (1980) work: discretion and coping.

Discretion (see, for example, Brodkin, 1997; Gulland, 2011; Lindhorst & Padgett, 2005; Smith & Donovan, 2003; Tummers & Bekkers, 2014) can be considered functional and often even necessary to be responsive to individual clients and their circumstances in various situations (Hupe & Hill, 2016), can make policies much more meaningful to clients, and can make a street-level bureaucrat more willing to implement a policy (Tummers & Bekkers, 2014), and can, however, also lead to unwanted consequences (Gulland, 2011; Lindhorst & Padgett, 2005; Maynard-Moody & Musheno, 2003; Smith & Donovan, 2003) such as a minimized access to services (Lindhorst & Padgett, 2005).

Coping, referring to the various ways street-level bureaucrats were theoretically believed to deal with the inevitable gap between work demands and resources available, was also issued in previous empirical work (see Brodkin, 1997, 2011; Meyers, Glaser, & MacDonald, 1998; Tummers et al., 2015). A systematic review into the coping behavior of frontline workers (Tummers et al., 2015) identified three types of coping strategies: moving toward clients, moving away from clients, and moving against clients. Moving toward clients, which means frontline workers adjust to meet the needs of clients (e.g., by bending/breaking the rules), was found the most frequent coping strategy. Moving away from clients, the previously mentioned routinizing (routine decision making) and rationing (making services less accessible or attractive), however, also occurred rather frequently (see, for example, Meyers et al., 1998; Winter, 2002). The final coping strategy, moving against clients (such as rigid rule-following), was found infrequently applied (Tummers et al., 2015).

Traditional (empirical) studies into street-level bureaucracy theory can roughly be divided in policy-focused studies that focused on how public policies are shaped by street-level practices in various areas, and management and government studies, which have studied the influence of street-level bureaucracy on changes in governance, management, and organizational practices. More recent, however, and relevant to our current study, emerging fields of study extended the boundaries of the street-level philosophy (Brodkin, 2012), and focused on the influence of street-level practices on access of services for clients and civilians. Generally, these studies revealed that street-level bureaucracy, causing nonconformity to prescribed policies, can lead to disparities in access to services and limited access to care for some (often disadvantaged) populations (see Brodkin & Majmundar, 2010; Monnat, 2010; Moynihan & Herd, 2010; Riccucci, 2005; Wenger & Wilkins, 2009). This may support our first hypothesis, stating that incarcerated offenders may also experience inadequate access to care as a result of prison employees not following the policy rules laid out.

The current study’s second hypothesis makes assumptions about the factors that, as offenders are expected not be allocated to programs based on the official guidelines, instead influence the decisions made by prison staff members, risk assessment outcomes (prioritizing those in more need for treatment, or those offenders who represent more manageable cases), and organizational circumstances (prioritizing cases in more optimal organizational conditions). Unfortunately, prison-based treatment referral decision making has, to date, not been studied along the lines of the street-level rationale, making it difficult to underpin our hypothesis with the results found in previous studies. To reinforce the second and third hypotheses brought forward, we are therefore forced to resort to previous studies in adjacent research areas, more specifically decision making by other actors in the criminal justice chain. Previous studies have demonstrated the relation between risk to reoffend and judicial decision making. Criminal justice actors such as judges (Hartley, Maddan, & Spohn, 2007; Spohn, 2000; Zatz, 2000) and parole- and probation officers (Carroll & Burke, 1990; Meyer, 2001) often rely on (factors relating to) the risk for reoffending in their judicial decision making. Earlier work has also shown the significance of organizational circumstances in judicial decision-making processes, as it has been shown that sentencing outcomes often vary between jurisdictional areas (see, for example, Johnson, Ulmer, & Kramer, 2008; Kautt & Spohn, 2002; Kautt, 2002; Ulmer & Johnson, 2004), and was found that bureaucracy (Engen & Steen, 2000; Johnson et al., 2008), organization size (Eisenstein, Flemming, & Nardulli, 1988), large caseloads (Dixon, 1995; Johnson, 2006; Johnson et al., 2008; Ulmer & Bradley, 2006; Ulmer & Johnson, 2004), and prison crowding (Johnson, 2006; Ulmer & Johnson, 2004) influenced judicial decision-making processes. For example, it was shown by Johnson (2006) that offenders were more often incarcerated in areas with more available jail space. In addition, studies have shown that parole boards take factors such as prison crowding and resources available into account, with overcrowding and less available resources resulting in more lenience in parole decision making (e.g., Glaser, 1985; Winfree, Sellers, Ballard, & Roberg, 1990).

In summary, there is an immense body of work to support street-level bureaucracy theory and its underlying concepts. This work has recently also been directed at issues relating to access to services, showing that, for some (disadvantaged) populations, access to services for certain clients and civilians is limited. This study aims to extend street-level bureaucracy theory to a new area by assessing if correctional rehabilitation policies in the Netherlands are delivered in practice, as they were formally designed, thereby studying if incarcerated offenders in the Netherlands have access to the care they are entitled to and are enrolled in treatment programs fitting with their individual needs. To further examine this issue, this study also aims to study if these treatment referrals can be explained by factors related to risk and need assessment outcomes, and organizational circumstances, which were theoretically expected to be related to the referral of offenders to treatment.

The Current Study

Effective correctional treatment aimed at reducing reoffending among offenders relies on a proper assessment of risk for future criminal behavior and criminogenic needs, and programs that fit both risk and needs. Previous studies have, however, issued a number of concerns relating to the use of risk assessment instruments to guide offenders to appropriate treatment (Latessa et al., 2002; Taxman & Bouffard, 2000). Street-level bureaucracy theory (Lipsky, 1980) suggests that this is because government employees do not always carry out policies as they were prescribed. It has, however, to date not been studied if this also applies to prison-based treatment referrals. The purpose of the current study was therefore to explore prison-based treatment referral decision-making processes. The following research questions were addressed:

  • Research Question 1: How many offenders were allocated to what types of treatment?

  • Research Question 2: Was the correct target population allocated to the right type of treatment? Our final research question read as follows:

  • Research Question 3: Which factors influenced these treatment allocation decision-making processes?

Inspired by street-level bureaucracy theory, treatment allocation was supposedly influenced by risk assessment outcomes and variables tied to organizational circumstances.

Method

Sample and Procedure

To address the research questions proposed in the current contribution, data were analyzed from a sample of 541 male offenders who, during their time in prison, entered the Dutch Prevention of Recidivism program. This sample was drawn from a population-based research sample of the Prison Project,1 which is a large-scale, longitudinal research project studying the effect of imprisonment on the life of detainees and their families in the Netherlands. This sample included all male detainees put in pretrial detention in the Netherlands between October 2010 and March 2011, who were between the ages of 18 and 65 and were born in the Netherlands (see Dirkzwager & Nieuwbeerta, 2016). Of the 3.981 offenders included in the Prison Project’s sample, 3.095 did not meet criteria to qualify as a rehabilitation program candidate (due to not meeting the 4-month minimal prison sentence criterion) and 345 eligible offenders did or could not participate in the program. This leaves a sample of 541 respondents who entered the Prevention of Recidivism program.

Several sources of information were used. First of all, risk assessment data were made available by the Dutch Probation Service. Second, the Dutch Custodial Institutions Agency provided registration data on all respondents. This included information from various prison registration systems and information on the Prevention of Recidivism program. And finally, to gather organizational information, a telephone-administered questionnaire was held. All Dutch prisons were asked to provide information concerning their prison crowding rates (per prison and per location), staff numbers, and the availability of in-house rehabilitation programs in each year our sample potentially was imprisoned in their facility.

Dependent Variables

Data on our dependent variable treatment type (neither, cognitive skill training, lifestyle training, or both) were collected using the Prison Registration System, in which in-depth information concerning the rehabilitation programs of every participant is registered. This involved information about all treatment programs included in an offender’s individual rehabilitation program. As mentioned, two main treatment programs are offered within the Prevention of Recidivism program: cognitive skills training and lifestyle training. Some additional (often nonstructured) forms of treatment are offered within Dutch prisons as well, such as counseling by a social worker, but these were not included in the current study due to infrequent application and/or registration and the nonstructured character of the treatment. Treatment type was coded 0 for offenders who were not referred to cognitive skill or lifestyle training, coded 1 for offenders referred to cognitive skills training, coded 2 for offenders who were referred to lifestyle training, and coded 3 for offenders referred to both treatment programs.

Independent and Control Variables

Risk scores were drawn from the RISc, a validated risk assessment tool based on the RNR principles used by probation officers and prisons in the Netherlands. With this instrument, an overall risk indication is made by summing item scores within 12 sections, which weighted combine into one overall risk score, with higher scores corresponding to higher risk and need levels. The 12 subsections each relate to a different risk domain: (a) offending history; (b) current offense and pattern of offenses (the scores on the first two domains are combined to form one score on past and current offenses); (c) accommodation; (d) education, work, and training; (e) financial management and income; (f) relationships with partner and relatives; (g) relationships with friends and other acquaintances; (h) drug misuse; (i) alcohol misuse; (j) emotional well-being; (k) thinking and behavior; and (l) attitudes/orientation (AVM & RO, 2004; Van der Knaap et al., 2012). Previous studies have indicated that the internal consistency, intraclass reliability, and predictive validity of the RISc are adequate (Van der Knaap et al., 2007; Van der Knaap & Alberda, 2009). As mentioned, risk assessment scores are supposed to be used to determine the type of treatment an offender requires. To be more specific, a high score on the criminogenic need scale, thinking and behavior, determines an offender’s need for cognitive skills training. And, following the inclusion criteria for lifestyle training, scores on the domains, drug misuse and alcohol misuse, are supposed to indicate the need for lifestyle training (substance abuse treatment). However, because of the explorative nature of the current study, weighted scores on each of the 12 scales were included as independent variables in the current study.

Organizational circumstances that were included were remaining prison sentence, prison crowding rate, rehabilitation staff/detainee ratio, and treatment programs on offer (cognitive skill and lifestyle training). The length of an offender’s prison sentence was drawn from the Prison Registration System. Prison crowding rate, rehabilitation staff/detainee ratio, and treatment programs on offer were all determined with the help of the Dutch prison service, which provided official records on each prison and each year studied. To determine prison crowding rates, yearly maximum capacity and occupation numbers were assembled by which crowding rates per year and per prison location could be calculated. Information regarding rehabilitation staff versus detainee ratios was calculated in a similar fashion.

Offender characteristics accounted for in the current study included age, ethnic background (native vs. nonnative), and type of offense (violent vs. nonviolent). Age was calculated from the prison registration systems by subtracting date of birth from the date of their prison entry. Ethnic background (nonnative vs. native) was obtained from risk assessment data (Statistics Netherlands defines a person as having a nonnative background if at least one of his or her parents was born abroad). And finally, offense type (nonviolent vs. violent) was drawn from the Criminal Record Office’s files.

Analyses

Subjects were first categorized into four mutually exclusive groups based on the content of their treatment program (0 = standard program with no specific treatment modules, 1 = standard program plus cognitive skills training, 2 = standard program plus lifestyle training, and 3 = standard program plus cognitive skills training and lifestyle training). The percentages of offenders who were categorized into the four groups were calculated, group descriptive statistics on independent variables (risk and need factors, personal characteristics, and organizational circumstances) were calculated, and group differences analyzed.

To determine if offenders were allocated to the correct type of treatment, actual treatment allocation (made in light of participation in the Prevention of Recidivism program) was compared with our own assessment of treatment allocation, determined based on risk and need assessment outcomes and treatments inclusion and exclusion criteria. In detail, offenders should be referred to cognitive skill training if the overall risk for reoffending is moderate to high, evidenced by a score of at least 32; there are cognitive deficits, evidenced by a weighted score on the RISc-scale, thinking and behavior, of at least 4; and an offender is not excluded based on additional grounds (Ministry of Justice, 2007). Offenders should be allocated to lifestyle training if they have drug-, alcohol-, and or gambling-abuse problems, evidenced by a score on the RISc scales, drug misuse, of at least 3, and/or alcohol misuse of at least 2, and or financial management and income of at least 5, with a minimal score of 2 on Item 5.4, and who are not excluded on additional grounds (SVG Verslavingsreclassering, 2009). Other, more general criteria accounting for both types of treatment include being older than 18 years, having sufficient Dutch-language skills and not being detained under hospital orders; however, offenders in our research group had already qualified for entry in the Prevention of Recidivism program and therefore already qualified on these grounds. Based on this assessment, it was determined how many offenders were correctly and incorrectly allocated, after which group descriptive statistics on independent variables were calculated and group differences analyzed.

To study which factors had influenced treatment allocation, bivariate analyses were used to describe the characteristics of the research population and to examine the relation between these characteristics and program allocation. Multinomial logistic regression analysis was then applied to test whether group membership (standard program vs. cognitive skill training; standard program vs. lifestyle training; standard program vs. both) depended on offender characteristics, risk factors, and organizational circumstances. Because of the somewhat modest sample size, and number of independent variables included in our hypothesized explorative model, a set of univariate multinomial logistic regression analyses was first performed to determine Wald and odds ratio (OR) statistics, after which, based on their p value, independent variables were included in a multivariate model. As suggested by Hosmer and Lemeshow (2000), a cutoff point for entry in the multivariate models of p < .15 was used. Presented results include ORs statistics. An OR, with values ranging from zero to infinity, greater than 1.00, indicates a higher probability of group membership, whereas OR of less than 1.00 indicates a decreased probability of group membership.

The independent variables that were included were control variables (age, ethnicity, and type of offense), risk factors (offending history, current offense and pattern of offenses, accommodation, education, work, and training, financial management and income, relationships with partner, family, and relatives, relationships with friends and acquaintances, drug misuse, alcohol misuse, emotional well-being, thinking and behavior, and attitudes and orientation), and organizational circumstances (remaining prison sentence in days, prison crowding rate, rehabilitation staff vs. detainee ratio, and availability of cognitive skill training and lifestyle training).

Results

Consultation of the Prevention of Recidivism program registration database showed that of our total research sample of 541 program participants, 50.3% of offenders (n = 272) were not referred to any specific treatment program, while others were referred to cognitive skill training (n = 126, 23.3%), lifestyle training (n = 61, 11.3%), or both cognitive skill and lifestyle training (n = 82, 15.2%). Relevant sample characteristics for each of the four treatment groups are summarized in Table 1.

Table 1.

Group Characteristics Offenders Allocated to No Treatment, Cognitive Skill Training, Lifestyle Training, and Both (N = 541).

1. Neither (n = 272)
2. Cognitive skill training (n = 126)
3. Lifestyle training (n = 61)
4. Both (n = 82)
Total (N = 541)
Significance
M (SD)/% M (SD)/% M (SD)/% M (SD)/% M (SD)/%
Control variables
 Age (in years) 31.5 (11.1) 26.1 (8.3) 31.0 (10.0) 28.9 (10.0) 29.8 (10.4) ***1/2 1/4 2/3
 Ethnicity (native) 61.8 41.3 60.7 65.9 57.5 ***1/2 2/3 2/4
 Offense type (nonviolent offense) 61.3 64.5 63.9 65.9 63.0
Risk factors
 Offending history and current offense (0-50) 17.4 (13.1) 18.8 (12.7) 21.3 (13.6) 21.4 (11.5) 18.8 (12.9) *1/3 1/4
 Accommodation (0-12) 4.1 (4.3) 3.2 (3.5) 4.4 (4.1) 4.9 (4.4) 4.0 (4.2) *1/2 2/4
 Education, work, and training (0-20) 9.0 (6.9) 9.2 (6.1) 9.5 (6.6) 10.9 (6.3) 9.4 (6.6)
 Financial management and income (0-12) 4.5 (3.8) 4.9 (3.4) 6.0 (3.9) 6.3 (3.8) 5.0 (3.8) ***1/3 1/4 2/4
 Relationships with partner and relatives (0-6) 2.7 (1.8) 2.4 (1.6) 2.9 (1.8) 2.8 (1.6) 2.7 (1.7)
 Relationships with friends and acq. (0-15) 5.8 (4.5) 6.8 (4.0) 6.1 (4.0) 8.0 (4.3) 6.4 (4.4) **1/2 1/4 3/4
 Drug misuse (0-15) 5.1 (5.3) 3.9 (4.5) 8.4 (4.6) 8.3 (4.5) 5.7 (5.2) ***1/2 1/3 1/4 2/3 2/4
 Alcohol misuse (0-5) 1.5 (1.9) 1.1 (1.6) 2.2 (1.9) 2.3 (2.0) 1.6 (1.9) ***1/2 1/3 1/4 2/3 2/4
 Emotional well-being (0-6) 2.4 (1.8) 1.8 (1.4) 2.4 (1.6) 2.3 (1.6) 2.2 (1.7) **1/2 2/3 2/4
 Thinking and behavior (0-12) 7.3 (3.5) 8.4 (2.3) 8.4 (2.8) 8.9 (2.4) 7.9 (3.1) ***1/2 1/3 1/4
 Attitudes and orientation (0-15) 6.1 (4.8) 6.0 (4.3) 7.1 (4.7) 7.3 (4.5) 6.4 (4.6)
Organizational circumstances
 Remaining prison sentence (in days) 732.7 (1,132.2) 613.7 (561.2) 387.0 (429.6) 735.1 (780.8) 666.4 (916.8) *1/3 3/4
 Prison crowding rate 0.9 (0.1) 0.9 (0.1) 0.9 (0.1) 0.9 (0.1) 0.9 (0.1)
 Rehabilitation staff/detainee ratio 116.9 (68.9) 107.3 (64.7) 103.7 (61.2) 109.8 (64.4) 112.1 (66.5)
 Cognitive skill training available (no) 21.0 15.1 16.4 17.1 18.5
 Lifestyle training available (no) 23.2 19.8 18.0 18.3 21.1

Note. Behind significant levels, it is demonstrated which groups differed. For example, 1/2 means post hoc analysis showed there was a significant difference between Group 1 and Group 2.

*

p < .05. **p < .01. ***p < .001.

First, regarding our included control variables, it was shown that offenders who were not referred to a criminogenic need-specific treatment module were older (M = 31.5), compared with offenders who were referred to cognitive skill training (M = 26.1), and both types of treatment (M = 28.9). Furthermore, offenders referred to cognitive skill training were younger compared with offenders who were referred to lifestyle training (M = 31.0). Regarding ethnicity, analyses indicated that offenders with a nonnative ethnic background were overrepresented in the cognitive skill training group.

Second, the differences on criminogenic need scales were quite diverse. In general, however, it appears that offenders who were allocated to lifestyle training reported somewhat higher scores on a range of criminogenic need scales and can therefore be considered somewhat more problematic. In addition, it must be mentioned that, perhaps contrary to what would be expected, it is not the case that offenders who were not referred to any program significantly and consequently score lower on the range of criminogenic need scales, compared with those who were referred to a criminogenic need-specific treatment module. In more detail; it was shown that offenders with lower scores on the domains, offending history and current offense, were mostly among those who were not referred to any program (M = 17.3), compared with offenders who were referred to lifestyle training (M = 21.3) and both types of treatment (M = 21.4). With respect to the risk scale, accommodation, it was shown that offenders with the lowest scores were mostly referred to cognitive skill training (M = 3.2), compared with offenders who were referred to neither (M = 4.1), or both (M = 4.9). Next, regarding the scale, financial management and income, post hoc analysis pointed out that offenders who were not referred to treatment scored lower (M = 4.5), compared with offenders who were referred to lifestyle training (M = 6.0) or both types of treatment (M = 6.3). Offenders referred to cognitive skill training also scored lower (M = 4.9), compared with offenders referred to both. Another scale on which groups were shown to differ is relationships with friends and acquaintances. With respect to this scale, program participants were shown to score the lowest (M = 5.8), compared with those referred to both cognitive skill training (M = 6.8), types of treatment (M = 8.0). Offenders who were referred to both, also differed significantly from those referred to lifestyle training (M = 6.1). Furthermore, our analyses pointed out a similar pattern for the risk scales, drug misuse and alcohol misuse. Offenders who were not referred to a specific treatment module, and therefore followed a standard treatment program, on average, scored higher (M = 5.1 and M = 1.5, respectively) compared with offenders who were referred to cognitive skill training (M = 3.9 and M = 1.1), but scored lower on drug and alcohol misuse than those referred to lifestyle training (M = 8.4 and M = 8.3), or both cognitive skill and lifestyle training (M = 2.2 and M = 2.3). The latter two also differed significantly from offenders in the second (cognitive skill training) group. With respect to scores on emotional well-being, it was shown that offenders in the group referred to cognitive skill training differed significantly (M = 1.8) from offenders referred to neither types of treatment (M = 2.4), lifestyle training (M = 2.4), and both treatment types (M = 2.3), with the cognitive skill training group reporting the lowest scores. And finally, concerning the risk scale, thinking and behavior, it was shown that offenders who were not referred to treatment reported lower scores (M = 7.3), compared with offenders referred to cognitive skill training (M = 8.4), lifestyle training (M = 8.4), and both (M = 8.9).

A third and final set of variables that was tested for group differences regarded organizational circumstances. As shown in Table 1, the only group differences found concerned the remaining prison sentence. It was shown that offenders who were allocated to lifestyle training reported lower remaining prison sentences (M = 387.0) than offenders who were referred to neither (732.7) or both (735.1) types of treatment. Perhaps this is caused by the fact that these offenders (i.e., offenders with substance abuse problems) committed specific types of crimes, for which they had received rather mild sentences. No other group differences were reported.

Correct Treatment Referrals Based on Risk Scores

As mentioned, treatment referrals should be made based on risk and need assessment scores. It was therefore explored if offenders in our research sample were referred to appropriate treatment.

An analyses of the risk assessment scores of our research group of 541 program participants has shown that, based on the official inclusion and exclusion criteria set, 215 offenders (39.7%) should have been referred to a standard program (no treatment), and 326 offenders (60.3%) should have been referred to either cognitive skill training, lifestyle training, or both. However, when comparing our assessment with the actual treatment programs that our research group of program participants was referred to, great differences were revealed. As shown in Table 2, 72 offenders (26.8% of all offenders allocated) were allocated to treatment, while they did not qualify for either cognitive skill or lifestyle training (or both) based on risk assessment outcomes. Second, 129 offenders (47.4% of all offenders not allocated) were not allocated to treatment, while they qualified for either cognitive skill or lifestyle training (or both) based on risk assessment outcomes.

Table 2.

Crosstab Treatment Allocation Based on PoR Program Versus Own Analyses (N = 541).

PoR program
Total
Allocated Not allocated
Should be allocated based on risk assessment outcomes 197 (64.9%) 129 (47.4%) 326
Should not be allocated based on risk assessment outcomes 72 (26.8%) 143 (52.6%) 215
Total 269 (100%) 272 (100%) 541

Note. A colored block indicates a wrongful inclusion or exclusion. PoR = Prevention of Recidivism.

A more detailed overview of the type of treatment program offenders were, and should have been, referred to (based on our analysis) is provided in Table 3. This table revealed a third type of error: offenders who were referred to the wrong type of treatment, which happened in 101 instances (51.3% of the total of 197 offenders allocated to a treatment program). In total, this leaves only 239 who could be considered correctly (not) allocated, 44.2% of our total research sample.

Table 3.

Crosstab Treatment Allocation Based on PoR Program Versus Own Analysis, Detailed (N = 541).

PoR program referrals
Total
Standard Cog. skill training Lifestyle training Both
Eligible for standard program, based on risk scores 143 (52.6%) 29 (23.0%)* 18 (29.5%) 25 (30.5%) 215
Eligible for cog. skill training, based on risk scores 58 (21.3%) 47 (37.3%) 13 (21.3%) 16 (19.5%) 134
Eligible for lifestyle training, based on risk scores 33 (12.1%) 12 (9.5%) 17 (27.9%) 9 (11.0%) 71
Eligible for both, based on risk scores 38 (14.0%) 38 (30.2%) 13 (21.3%) 32 (39.0%) 121
Total 272 (100%) 126 (100%) 61 (100%) 82 (100%) 541

Note. A colored block indicates a wrongful inclusion or exclusion. PoR = Prevention of Recidivism.

To further explore the groups of correctly classified offenders and incorrectly classified offenders (incorrectly allocated, incorrectly not allocated, and allocated to an incorrect treatment type), an analysis on background characteristics was conducted, the results of which are presented in Table 4. As shown, the group of correctly classified offenders differed from incorrectly classified offenders, on a considerable number of variables. In general, it was shown that offenders, who were referred to treatment in line with their risk and need assessment outcomes, were more often imprisoned for having committed a nonviolent offense, than offenders who were incorrectly classified. They also differed on a large number of risk assessment domains, where they scored lower (than incorrectly classified offenders) on the domains, offending history; current offense; education, work, and training; financial management and income; drug misuse; thinking and behavior; and attitudes and orientation. And finally, correctly classified offenders were, on average, imprisoned for slightly less days, than offenders who were incorrectly classified. In general, it appears that offenders who were correctly assigned to treatment represent a lower risk group of offenders, who received a slightly less severe sentence for having committed a less severe crime.

Table 4.

Group Characteristics Correctly Classified Offenders, and Three Types of Incorrectly Classified Offenders (N = 541).

Correctly classified (n = 239)
Incorrectly classified, incorrect allocation (n = 72)
Incorrectly classified, incorrect nonallocation (n = 129)
Incorrectly classified, incorrect treatment type (n = 101)
Total (N = 541) Significance
M (SD)/% M (SD)/% M (SD)/% M (SD)/% M (SD)/%
Offender characteristics
 Age (in years) 29.9 (10.8) 31.4 (12.0) 29.2 (10.3) 29.2 (8.4) 29.8 (10.4)
 Ethnicity (native) 55.2 58.3 62.0 56.4 57.5
 Offense type (nonviolent offense) 30.4 23.9 45.7 50.5 37.0 ***1/3 1/4 2/3 2/4
Risk factors
 Offending history and current offense (0-50) 17.0 (13.0) 19.7 (13.0) 19.3 (12.2) 21.6 (13.0) 18.8 (12.9) *1/4
 Accommodation (0-12) 3.9 (4.2) 5.9 (4.2) 3.5 (4.0) 3.8 (4.0 4.0 (4.2) **1/2 2/3 2/4
 Education, work and training (0-20) 8.4 (6.8) 11.7 (7.2) 9.8 (6.3) 9.6 (5.8) 9.4 (6.6) **1/2 2/4
 Financial management and income (0-12) 4.5 (3.7) 6.1 (3.9) 4.5 (3.8) 6.1 (3.6) 5.0 (3.8) ***1/2 1/4 2/3
 Relationships with partner and relatives (0-6) 2.5 (1.9) 3.6 (1.9) 2.6 (1.5) 2.4 (1.4) 2.7 (1.7) ***1/2 2/3 2/4
 Relationships with friends and acq. (0-15) 6.0 (4.6) 7.5 (4.7) 6.2 (4.1) 6.8 (4.0) 6.4 (4.4)
 Drug misuse (0-15) 4.7 (5.4) 7.4 (5.7) 5.4 (4.9) 7.2 (4.4) 5.7 (5.2) ***1/2 1/4 2/3 3/4
 Alcohol misuse (0-5) 1.4 (1.9) 2.0 (2.1) 1.6 (1.8) 1.9 (1.7) 1.6 (1.9)
 Emotional well-being (0-6) 2.2 (1.8) 3.1 (1.9) 2.0 (1.5) 2.0 (1.3) 2.2 (1.7) ***1/2 2/3 2/4
 Thinking and behavior (0-12) 7.4 (3.4) 9.2 (3.1) 7.8 (2.8) 8.6 (2.2) 7.9 (3.1) ***1/2 1/4 2/3 3/4
 Attitudes and orientation (0-15) 5.6 (4.8) 8.1 (5.3) 6.7 (4.3) 6.8 (3.9) 6.4 (4.6) **1/2 1/3 1/4 2/3
Organizational circumstances
 Prison sentence (in days) 774.3 (1083.3) 610.0 (720.5) 572.4 (855.2) 571.4 (624.8) 666.4 (916.8)
 Prison crowding rate 92.1 (10.2) 94.4 (6.0) 93.2 (9.6) 92.5 (10.9) 97.9 (9.8)
 Rehabilitation staff/detainee ratio 115.3 (67.0) 103.8 (52.7) 113.7 (70.9) 108.3 (67.7) 112.1 (66.5)
 Cognitive skill training available (no) 79.1 81.9 80.6 88.1 81.5
 Lifestyle training available (no) 76.6 81.9 78.3 83.2 78.9
*

p < .05. **p < .01. ***p < .001.

Although our analyses make clear that inaccuracies seem to be present in referrals made, it must be mentioned that the analysis conducted was solely based on risk and need assessment outcomes; consequently, our analysis did not take into account any additional factors that may sometimes also influence treatment referrals, such as suitability for (group) treatment. These (not incorporated) factors may not be included in a risk assessment instrument, but could instead be observed in personal engagement with an offender, after which it can influence treatment referral decisions. The presented results are therefore perhaps a somewhat simplistic representation of correctional treatment referral practices, as we only had access to data, and could not interact with people. However, the fact that treatment was not in line with risk assessment outcomes in so many cases leaves us to wonder about the quality of current practices, and raises the question as to which factors have influenced treatment referrals.

Exploring Decision-Making Processes: Bivariate Analyses

As shown, treatment referrals made in light of the Prevention of Recidivism program are not made fully in line with risk and need assessment outcomes. Therefore, we will now explore which factors have influenced these decision-making processes. Before turning to the results of our multivariate model, a set of univariate analysis was performed to test each variable that, based on the theoretical framework, was believed to determine treatment referral decision-making processes. As mentioned, variables were included in the multivariate models explaining treatment referral decision making if they had a significant univariate test, as evidenced by a p value cutoff point of .15 (see Hosmer & Lemeshow, 2000). Based on the results presented in Table 5, the control variables’ age and ethnicity were included, all 11 risk factor domains were included, and organizational factors prison sentence in days, and prison crowding rate were included in our multivariate multinomial logistic regression analysis treatment group membership.

Table 5.

Bivariate ORs Independent Variables on Treatment Allocation (N = 541).

Cognitive skill training versus standard program
Lifestyle training versus standard program
Cognitive skill training and lifestyle training versus standard program
OR CI p OR CI p OR CI p
Control variables
 Age (in years) 0.94 [0.92, 0.97] .000* 1.00 [0.97, 1.02] .748 0.98 [0.96, 1.00] .060*
 Ethnicity (native) 2.30 [1.50, 3.54] .000* 1.05 [0.59, 1.85] .872 0.84 [0.50, 1.41] .502
 Offense type (nonviolent offense) 0.87 [0.56, 1.35] .535 0.89 [0.50, 1.59] .697 0.82 [0.49, 1.38] .452
Risk factors
 Offending history and current offense 1.01 [0.99, 1.03] .319 1.02 [1.00, 1.05] .033* 1.02 [1.01, 1.04] .015*
 Accommodation 0.94 [0.89, 1.00] .038* 1.02 [0.95, 1.09] .561 1.05 [0.99, 1.11] .125*
 Education, work, and training 1.00 [0.97, 1.04] .805 1.01 [0.97, 1.06] .608 1.04 [1.01, 1.09] .032*
 Financial management and income 1.03 [0.97, 1.09] .302 1.11 [1.03, 1.20] .006* 1.14 [1.07, 1.22] .000*
 Relationships with partner and relatives 0.89 [0.78, 1.01] .074* 1.09 [0.93, 1.28] .309 1.02 [0.88, 1.18] .798
 Relationships with friends and acquaintances 1.06 [1.01, 1.11] .030* 1.02 [0.95, 1.09] .578 1.13 [1.06, 1.20] .000*
 Drug misuse 0.95 [0.91, 1.00] .032* 1.14 [1.07, 1.21] .000* 1.13 [1.07, 1.19] .000*
 Alcohol misuse 0.86 [0.76, 0.98] .023* 1.19 [1.03, 1.38] .019* 1.23 [1.08, 1.41] .002*
 Emotional well-being 0.79 [0.68, 0.91] .001* 1.02 [0.86, 1.20] .851 0.97 [0.84, 1.13] .706
 Thinking and behavior 1.12 [1.04, 1.21] .003* 1.13 [1.02, 1.24] .020* 1.22 [1.10, 1.34] .000*
 Attitudes and orientation 0.99 [0.95, 1.04] .803 1.04 [0.98, 1.11] .167 1.06 [1.00, 1.11] .053*
Organizational circumstances
 Remaining prison sentence (in days) 1.00 [1.00, 1.00] .245 1.00 [1.00, 1.00] .006* 1.00 [1.00, 1.00] .985
 Prison crowding rate 0.56 [0.07, 4.31] .578 1.31 [0.07, 23.29] .855 26.24 [0.90, 767.06] .058*
 Rehabilitation staff/detainee ratio 1.00 [0.99, 1.00] .194 1.00 [0.99, 1.00] .187 1.00 [1.00, 1.00] .423
 Cognitive skill training available (no) 1.49 [0.85, 2.64] .167 1.35 [0.65, 2.83] .423 1.29 [0.68, 2.46] .442
 Lifestyle training available (no) 1.22 [0.72, 2.05] .458 1.37 [0.67, 2.79] .385 1.35 [0.72, 2.52] .352

Note. If p < .15, the variable will be included in the multivariate model (*). OR = odds ratio; CI = confidence interval.

Exploring Decision-Making Processes: Multivariate Analyses

The results of the multinomial regression analysis, testing the influence of indicators of risk factors and organizational circumstances on treatment group membership, are presented in Table 6. Presented results above include ORs statistics. Offenders who were not referred to cognitive skill or lifestyle training (standard treatment) represent the reference group.

Table 6.

Multinomial Regression Analyses on Treatment Allocation (N = 541).

Cognitive skill training versus standard program
Lifestyle training versus standard program
Cognitive skill training and lifestyle training versus standard program
OR CI Significant OR CI Significant OR CI Significant
Control variables
 Age (18-65) 0.97 [0.94, 1.00] * 0.98 [0.95, 1.02] 0.97 [0.94, 1.00]
 Ethnicity (nonnative) 0.98 [0.86, 1.12] 0.93 [0.81, 1.08] 1.02 [0.85, 1.22]
Risk indicators
 Offending history and current offense 1.02 [0.99, 1.04] 1.01 [0.98, 1.04] 1.00 [0.97, 1.03]
 Accommodation 0.96 [0.88, 1.03] 0.96 [0.87, 1.05] 1.00 [0.92, 1.09]
 Education, work, and training 0.97 [0.93, 1.03] 0.93 [0.87, 0.99] * 0.96 [0.90, 1.01]
 Financial management and income 1.11 [1.03, 1.20] ** 1.11 [1.00, 1.22] * 1.09 [1.00, 1.19] *
 Relationships with partner and relatives 0.97 [0.81, 1.17] 1.11 [0.88, 1.39] 0.90 [0.73, 1.12]
 Relationships with friends and acquaintances 1.06 [0.98, 1.13] 0.91 [0.83, 1.00] * 1.05 [0.96, 1.14]
 Drug misuse 0.94 [0.88, 0.99] * 1.18 [1.09, 1.28] *** 1.12 [1.05, 1.45] **
 Alcohol misuse 0.91 [0.78, 1.06] 1.10 [0.93, 1.32] 1.24 [0.54, 0.86] *
 Emotional well-being 0.66 [0.54, 0.82] *** 0.75 [0.58, 0.97] * 0.68 [1.09, 1.49] **
 Thinking and behavior 1.39 [1.22, 1.59] *** 1.16 [0.99, 1.37] 1.28 [0.88, 1.04] **
 Attitudes and orientation 0.92 [0.85, 0.99] * 1.00 [0.91, 1.10] 0.96 [0.88, 1.04]
Context features
 Remaining prison sentence (in days) 1.00 [1.00, 1.00] 1.00 [1.00, 1.00] 1.00 [1.00, 1.00] **
 Prison crowding rate 0.31 [0.03, 3.54] 0.63 [0.02, 19.16] 6.30 [0.15, 274.24]

Note. Overall model Wald χ²(183.964, 45), p < .001, Cox and Snell R² = .307, Nagelkerke R² = .336. OR = odds ratio; CI = confidence interval.

*

p < .05. **p < .01. ***p < .001.

The results show that treatment group membership was significantly associated with age. Being older appeared to decrease chances of being referred to cognitive skill training, compared with not being referred to treatment (OR = 0.97). Ethnic background did not seem to determine treatment group membership.

With respect to risk factors included in the multivariate model, a broad range of effects was found, each of which will be discussed by risk domain. First, concerning the risk domain, education, work, and training, results pointed out that a higher score on this domain decreased referrals to substance abuse training (lifestyle training), compared with not being referred to treatment (OR = 0.93). Concerning problem relating to financial management and income, it was shown that more (severe) risk scores increased chances of being referred to cognitive skill training (OR = 1.11), lifestyle training (OR = 1.11), as well as both types of treatment (OR = 1.09). On the contrary, higher scores in the area of relationships with friends and acquaintances appeared to lower chances of lifestyle training treatment group membership, compared with no treatment group membership (OR = 0.91). Continuing, higher scores on the criminogenic need scale, drug misuse, decreased odds of cognitive skill training group membership by 6% per point lower scored (OR = 0.94), whereas it increased odds of lifestyle training group membership by 18% per scored point (OR = 1.18) and both treatment group membership by 12% per scored point (OR = 1.12). With respect to alcohol misuse, it was shown that more severe problems increased chances of being referred to both types of treatment, compared with not being referred (OR = 1.24). Higher reported scores on the risk domain, emotional well-being, seemed to quite heavily decrease one’s odd of being among the group of offenders referred to both cognitive skill training (OR = 0.66), lifestyle training (OR = 0.75), as well as both types of treatment (OR = 0.68). Scores on the criminogenic need scale, thinking and behavior, increased chances of treatment referrals to cognitive skill training (OR = 1.39), and to cognitive skill and lifestyle training (OR = 1.29). And finally, a higher score on the scale, attitudes and orientation, decreased chances of being referred to cognitive skill training, compared with being referred to neither types of treatment (OR = 0.92).

Concerning context features, only one significant result was reported. A longer prison sentence (measured in days) increased odds of both types of treatment group membership, compared with not being referred to treatment (OR = 1.00). None of the remaining contextual features was associated with group membership.

The overall model was found to be statistically significant (p = .000). Statistics also indicated that the model was a good fit for the data, evidenced by Nagelkerke’s R2 and Cox and Snell statistics.

Discussion

To effectively apply correctional treatment programs, offenders should be allocated to treatment based on risk and need assessment outcomes (Latessa et al., 2002). Studies have, however, shown that a number of problems exist regarding the implementation of risk assessment in correctional practices and have indicated that risk assessment may seldom be used to allocate offenders to treatment, even if policies describe such a risk and need-based approach (Latessa et al., 2002; Taxman & Bouffard, 2000). Lipsky’s (1980) street-level bureaucracy theory suggests that this could be explained by the fact that public service employees do not always apply policies as prescribed. The goal of the study discussed in this chapter was twofold. First, this study aimed to determine if treatment referrals made in light of the Dutch Prevention of Recidivism were made in line with risk and need assessment outcomes, by means of which it was tested whether discrepancies were present between policy as prescribed, and policies as carried out in practice, as it was expected based on the work of Lipsky (1980). Second, this study aimed to assess which factors determined treatment allocation decision-making processes. Inspired by street-level bureaucracy theory (Lipsky, 1980) and supported by previous studies in the broad field of criminal justice research, risk assessment outcomes and organizational circumstances were expected to determine prison-based treatment referrals. The research questions proposed were as follows: (a) How many offenders were allocated to what types of treatment? (b) Was the correct target population allocated to the right type of treatment? (c) Which factors influenced treatment allocation decision-making processes? To examine our research questions, registration data were analyzed from a sample of 541 male offenders who participated in the prison-based Prevention of Recidivism program in the Netherlands.

Main Results

The results presented in this section first of all showed that over half of the detainees included in our sample were not referred to any specific treatment program. An analysis on background factors revealed that there were some differences between the groups of offender’s allocated to different types of treatment, the most striking of which was perhaps the fact that offenders who were not referred to a criminogenic need-specific program did not score lower with respect to criminogenic need scales, compared with those who were referred to a criminogenic need-specific treatment module.

Second, the current study made clear that treatment allocation in light of the Prevention of Recidivism program was not at all times in line with risk and need assessment outcomes. As a result, over half of our research group was incorrectly classified, that is, not referred to a treatment program that was in line with their risk assessment outcomes. In most cases, this resulted in offenders than were referred to a standard treatment program (containing no criminogenic need-specific treatment modules) who, based on their risk and need assessment outcomes, should have been referred to a criminogenic need-specific treatment program. Further examination of the characteristics of correctly and incorrectly classified offenders revealed that offenders who were imprisoned for having committed a less severe crime, who scored lower on several risk assessment subscales, were more often correctly classified. This leads us to conclude that high-risk offenders were more often incorrectly (not) referred to treatment.

Subsequently, it was studied which factors influenced treatment referrals to specific treatment programs. Results showed that control variables (demographics), in general, did not influence treatment group membership, with the exception of age; it was shown that an older age negatively influenced treatment referrals to cognitive skill training. A large number of risk factors did, however, influence treatment referrals. In general, it was shown that higher scores on the scales, financial management and income, alcohol misuse, and thinking and behavior, increased referrals to treatment, whereas higher scores regarding the domains, education, work, and training; relationships with friends and acquaintances; emotional well-being; and attitudes and orientation, decreased referrals, while results concerning the scale, drug misuse, were mixed. In addition, organizational circumstances were not shown to be related to treatment group membership, with the exception of a longer prison sentence, which increased referrals to a combination of cognitive skill and lifestyle training.

In conclusion, as treatment allocation practices were not in line with prescribed standards, this study supports the premise made by street-level bureaucracy theory (Lipsky, 1980), suggesting that public service employees do not always apply policies as prescribed. This discrepancy between policy and practice was as hypothesized, and also congruent with the results of previous work in various public service areas (see Brodkin, 2012 for an overview). The consequence of this discrepancy with policy as written and policy as produced is that Dutch prisoners who qualify for (and are in need of) treatment, do not have access to the services they are entitled to. This result is in line with outcomes of previous work in the broad area of government services, concluding that vulnerable or disadvantaged populations often experience limited access to services and care (see Brodkin & Majmundar, 2010; Monnat, 2010; Moynihan & Herd, 2010; Riccucci, 2005; Wenger & Wilkins, 2009).

In addition, relating to our third and final research question, it can be concluded that referrals made as part of participation in the Dutch prison-based Prevention of Recidivism program were influenced by a broad range of risk and need assessment scores. Unfortunely, the strict guidelines that were set up to direct offenders to specifoc programs, were not applied.In many cases it was shown that offenders with a lower risk and/or less severe criminogenic needs, easier clients, were more often correctly classified compared to offenders with a higher risk and/or more severe criminogenic needs. This was in line with our second hypothesis, and indicates coping, and creaming in particular, giving priority to decisions that involve easier and manageable clients and cases (Lipsky, 1980, 2010); which was also found to be applied in other areas of public service (Tummers et al., 2015). Organizational circumstances were, however, contrary to expectations as factors such as prison overcrowding were shown to influence other criminal justice actors such as parole boards (Glaser, 1985; Winfree et al., 1990), not found to be of much influence on (correct and incorrect) treatment referrals. Finally, we have to conclude that a large proportion of the variance in treatment allocation between our studied groups remained unexplained. Consequently, it also appears that there are other factors involved, not included in this study, which no doubt also influenced treatment referral decision-making processes.

As studies have shown that treatment can only be effective if it adheres to RNR principles, the fact that such a large proportion of offenders ended up in treatment not in line with their risk and need assessment scores leads us to temper our expectations regarding the effectiveness of treatment modules applied within the scope of the Prevention of Recidivism program. Nonetheless, although shortcomings in a risk–need driven approach were certainly demonstrated, problems identified by previous work (see, for example, Latessa et al., 2002; Taxman & Bouffard, 2000), proposing that proper risk assessment was often not conducted, and was seldom used to allocate offenders to treatment, were not found.

Limitations

Although this study represents a major advancement in the field of correctional rehabilitation research, there are some limitations that should be mentioned. A first shortcoming is perhaps related to the explorative model presented in the current study. Inspired by street-level bureaucracy theory, it was tested if variables tied to two specific domains were related to prison-based treatment referral decision-making processes. Because of the innovatory nature of this study, the current study could not rely on variables appointed by theory and previous studies, and therefore had to create a set of variables that were believed to be salient. Although well substantiated, as the selected variables were based on similar studies conducted in adjacent research fields, other factors could have also contributed to treatment referral processes. It requires further study to develop the model introduced in this study and to fully comprehend prison-based treatment referral decision-making processes.

A second set of limitations were related to the study’s data and design. First, this study was conducted in the Netherlands, and studied a sample of male detainees who were born in the Netherlands. The results can therefore not be generalized to rehabilitation programs implemented in other geographic regions, or to offenders detained in the Netherlands who were born abroad. Second, our measures included were limited to official registration (risk assessment) data and did not include background information on prison staff members making treatment referrals. Also, measures of organizational circumstances were fairly broad and limited. It would be a great advancement if future research could incorporate more specific measures on both prison staff members and prisons.

Author Biographies

A. Q. Bosma works as assistant professor in the Institute for Criminal Law & Criminology at Leiden University. Her research interests include the effects of imprisonment on the life course of (ex-)detainees and the effects of correctional treatment and rehabilitation programs.

M. J. J. Kunst is an associate professor in the Institute for Criminal Law & Criminology at Leiden University. His research interests include victimological psychology, trauma psychology, and decision making regarding psychiatric diagnoses.

A. J. E. Dirkzwager works as a senior researcher at the Netherlands Institute for the Study of Crime and Law Enforcement. Her research interests include the physical and psychosocial well-being of prisoners and their family members, and the effects of imprisonment on their further life course.

P. Nieuwbeerta is a professor of criminology in the Institute for Criminal Law & Criminology at Leiden University. His research interests include criminal behavior over the life course, homicide, and the determinants and consequences of imprisonment.

1.

The Prison Project is financially supported by the University of Leiden, the Netherlands Institute for the Study of Crime and Law Enforcement (NSCR), the Netherlands Organization for Scientific Research (NWO), and Utrecht University.

Footnotes

Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The author(s) received no financial support for the research, authorship, and/or publication of this article.

References

  1. Adviesbureau van Montfoort & Reclassering Nederland. (2004). RISc versie 1.0. Recidive InschattingsSchalen. Handleiding [RISc version. 1.0 Recidivism Assessment Scales, manual]. Utrecht: Reclassering Nederland. [Google Scholar]
  2. Andrews D. A., Bonta J. (2010). Rehabilitating criminal justice policy and practice. Psychology, Public Policy and Law, 16, 39-55. [Google Scholar]
  3. Andrews D. A., Bonta J., Hoge R. D. (1990). Classification for effective rehabilitation: Rediscovering psychology. Criminal Justice and Behavior, 17, 19-52. [Google Scholar]
  4. Andrews D. A., Bonta J., Wormith J. S. (2004). Level of Service/Case Management Inventory (LS/CMI): An offender assessment system. Toronto, Ontario, Canada: Multi-Health Systems. [Google Scholar]
  5. Andrews D. A., Bonta J., Wormith J. S. (2006). The recent past and near future of risk and/or need assessment. Crime & Delinquency, 52, 7-27. [Google Scholar]
  6. Bonta J., Andrews D. A. (2007). Risk-need-responsivity model for offender assessment and rehabilitation. Ottawa, Ontario: Public Safety Canada. [Google Scholar]
  7. Bosma A. Q., Kunst M. J. J., Nieuwbeerta P. (2013). Rehabilitatie in Nederlandse gevangenissen: Wat is de stand van zaken ten aanzien van de uitvoering en doelmatigheid van het programma Terugdringen Recidive? [Rehabilitation in Dutch prisons: The state of the art concerning a prison-based treatment program in the Netherlands]. Tijdschrift voor Veiligheid, 12(3), 3-19. [Google Scholar]
  8. Brodkin E. Z. (1997). Inside the welfare contract: Discretion and accountability in state welfare administration. The Social Service Review, 71, 1-33. [Google Scholar]
  9. Brodkin E. Z. (2011). Policy work: Street-level organizations under new managerialism. Journal of Public Administration Research and Theory, 21, 253-277. [Google Scholar]
  10. Brodkin E. Z. (2012). Reflections on street-level bureaucracy: Past, present, and future. Public Administration Review, 72, 940-949. [Google Scholar]
  11. Brodkin E. Z., Majmundar M. (2010). Administrative exclusion: Organizations and the hidden costs of welfare claiming. Journal of Public Administration Research and Theory, 20, 827-846. [Google Scholar]
  12. Brown M. K. (1981). Working the street: Police discretion and the limits of reform. New York, NY: Russell Sage Foundations. [Google Scholar]
  13. Carroll J. S., Burke P. A. (1990). Evaluation and prediction in expert parole decisions. Criminal Justice and Behavior, 17, 315-332. [Google Scholar]
  14. Cowan D., Hitchings E. (2007). Pretty boring stuff: District judges and housing possession proceedings. Social & Legal Studies, 16, 363-382. [Google Scholar]
  15. Cullen F. T., Gendreau P. (2001). From nothing works to what works: Changing professional ideology in the 21st century. The Prison Journal, 81, 313-338. [Google Scholar]
  16. Dirkzwager A. J. E., Nieuwbeerta P. (2016). The prison project: A cohort profile. Leiden: Internal Publication. [Google Scholar]
  17. Dixon J. (1995). The organizational context of criminal sentencing. American Journal of Sociology, 100, 1157-1198. [Google Scholar]
  18. Eisenstein J., Flemming R. B., Nardulli P. F. (1988). The contours of justice: Communities and their courts. Boston, MA: Little, Brown. [Google Scholar]
  19. Ellis K. (2007). Direct payments and social work practice: The significance of street-level bureaucracy in determining eligibility. British Journal of Social Work, 37, 405-422. [Google Scholar]
  20. Ellis K. (2011). Street-level bureaucracy revisited: The changing face of frontline discretion in adult social care in England. Social Policy & Administration, 45, 221-244. [Google Scholar]
  21. Gendreau P. (1996). Offender rehabilitation: What we know and what needs to be done. Criminal Justice and Behaviour, 23, 144-161. [Google Scholar]
  22. Glaser D. (1985). Who gets probation and parole: Case study versus actuarial decision making. Crime & Delinquency, 31, 367-378. [Google Scholar]
  23. Gulland J. (2011). Ticking boxes: Decision-making in employment and support allowance. Journal of Social Security Law, 18, 68-85. [Google Scholar]
  24. Guy M. E., Newman M. A., Mastracci S. H. (2008). Emotional labor: Putting the service in public service. Armonk, NY: M.E. Sharpe. [Google Scholar]
  25. Hannah-Moffat K. (2005). Criminogenic needs and the transformative risk subject: Hybridizations of risk/need in penality. Punishment & Society, 7, 29-51. [Google Scholar]
  26. Hartley R. D., Maddan S., Spohn C. C. (2007). Concerning conceptualization and operationalization: Sentencing data and the focal concerns perspective, a research note. Southwest Journal of Criminal Justice, 4, 58-78. [Google Scholar]
  27. Hosmer D. W., Lemeshow S. (2000). Applied logistic regression. New York, NY: John Wiley. [Google Scholar]
  28. Howard P., Clark D., Garnham N. (2003). An evaluation and validation of the Offender Assessment System (OASys). London, England: OASys Central Research Unit. [Google Scholar]
  29. Hughes T., Wilson D. J. (2002). Re-entry trends in the United States. Washington, DC: U.S. Department of Justice, Bureau of Justice Assistance. [Google Scholar]
  30. Hupe P. L., Hill M. J. (2016). “And the rest is implementation.” Comparing approaches to what happens in policy processes beyond Great Expectations. Public Policy and Administration, 31, 103-121. [Google Scholar]
  31. Inspectorate of Security and Justice. (2010). Samenwerkingsmodel Terugdringen Recidive [Cooperation model Prevention of Recidivism Program]. Den Haag, The Netherlands: Inspectorate of Security and Justice. [Google Scholar]
  32. Johnson B. D. (2006). The multilevel context of criminal sentencing: Integrating judge-and county-level influences. Criminology, 44, 259-298. [Google Scholar]
  33. Johnson B. D., Ulmer J. T., Kramer J. H. (2008). The social context of guidelines circumvention: The case of federal district courts. Criminology, 46, 737-783. [Google Scholar]
  34. Jolley M. J., Kerbs J. J. (2010). Risk, need, and responsivity: Unrealized potential for the international delivery of substance abuse treatment in prison. International Criminal Justice Review, 20, 280-301. [Google Scholar]
  35. Kautt P. M. (2002). Location, location, location: Interdistrict and intercircuit variation in sentencing outcomes for federal drug-trafficking offenses. Justice Quarterly, 19, 633-671. [Google Scholar]
  36. Kautt P. M., Spohn C. (2002). Cracking down on black drug offenders? Testing for interactions among offenders’ race, drug type, and sentencing strategy in federal drug sentences. Justice Quarterly, 19, 1-35. [Google Scholar]
  37. Knaap L. M., Alberda D. L. (2009). De predictieve validiteit van de recidive inschattingsschalen (RISc) [The predictive validity of the Dutch risk assessment scales (RISc)]. Den Haag, The Netherlands: Wetenschappelijk Onderzoek en Documentatie Centrum.. [Google Scholar]
  38. Knaap L. M., van der, Leenarts L. E. W., Nijssen L. T. J. (2007). Psychometrische kwaliteiten van de Recidive Inschattingsschalen (RISc): Interbeoordelaars-betrouwbaarheid, interne consistentie en congruente validiteit [Psychometric qualities of the Dutch risk assessment scales (RISc): Inter-rater reliability, internal consistency and congruent validity]. Den Haag, The Netherlands: Wetenschappelijk Onderzoek en Documentatie Centrum. [Google Scholar]
  39. Latessa E. J., Cullen F. T., Gendreau P. (2002). Beyond correctional quackery: Professionalism and the possibility of effective treatment. Federal Probation, 66, 43-49. [Google Scholar]
  40. Lehmann Nielsen V. (2006). Are street-level bureaucrats compelled or enticed to cope? Public Administration, 84, 861-889. [Google Scholar]
  41. Lindhorst T., Padgett J. D. (2005). Disjunctures for women and frontline workers: Implementation of the family violence option. The Social Service Review, 79, 405-429. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Lipsey M. W., Cullen F. T. (2007). The effectiveness of correctional rehabilitation: A review of systematic reviews. The Annual Review of Law and Social Science, 3, 297-320. [Google Scholar]
  43. Lipsky M. (1980). Street-level bureaucracy: Dilemmas of the individual in public services. New York, NY: Russell Sage Foundation. [Google Scholar]
  44. Lipsky M. (2010). Street-level bureaucracy: Dilemmas of the individual in public service (30th Ann. ed). New York, NY: Russell Sage Foundation. [Google Scholar]
  45. Lowenkamp C. T., Latessa E. J. (2005). Increasing the effectiveness of correctional programming through the risk principle: Identifying offenders for residential placement. Criminology & Public Policy, 4, 263-290. [Google Scholar]
  46. Lowenkamp C. T., Latessa E. J., Holsinger A. M. (2006). The risk principle in action: What have we learned from 13.676 offenders and 97 correctional programs? Crime & Delinquency, 52, 77-93. [Google Scholar]
  47. Lowenkamp C. T., Latessa E. J., Smith P. (2006). Does correctional program quality really matter? The impact of adhering to the principles of effective intervention. Criminology & Public Policy, 5, 575-594. [Google Scholar]
  48. Mastrofski S. D., Worden R. E., Snipes J. B. (1995). Law enforcement in a time of community policing. Criminology, 33, 539-563. [Google Scholar]
  49. Matthews B., Hubbard D. J., Latessa E. (2001). Making the next step: Using evaluability assessment to improve correctional programming. The Prison Journal, 81, 454-472. [Google Scholar]
  50. Maynard-Moody S., Musheno M. C. (2000). State agent or citizen agent: Two narratives of discretion. Journal of Public Administration Research and Theory, 10, 329-358. [Google Scholar]
  51. Maynard-Moody S., Musheno M. C. (2003). Cops, teachers, counselors: Stories from the front lines of public service. Ann Arbor: University of Michigan Press. [Google Scholar]
  52. Maynard-Moody S., Portillo S. (2010). Street-level bureaucracy theory. In Durant R. (Ed.), Oxford handbook of American bureaucracy (pp. 252-277). Oxford, UK: Oxford University Press. [Google Scholar]
  53. Meyer J. A. F. (2001). Strange science: Subjective criteria in parole decisions. Journal of Crime and Justice, 24, 43-70. [Google Scholar]
  54. Meyers M. K., Glaser B., MacDonald K. (1998). On the front lines of welfare delivery: Are workers implementing policy reforms? Journal of Policy Analysis and Management, 17, 1-22. [Google Scholar]
  55. Ministry of Justice. (2007). De theoretische handleiding van de training voor cognitieve vaardigheden [Theoretical manual of the cognitive skill training]. Den Haag, The Netherlands: Ministerie van Justitie. [Google Scholar]
  56. Monnat S. M. (2010). The color of welfare sanctioning: Exploring the individual and contextual roles of race on TANF case closures and benefit reductions. The Sociological Quarterly, 51, 678-707. [DOI] [PubMed] [Google Scholar]
  57. Moynihan D., Herd P. (2010). Red tape and democracy: How rules affect citizenship rights. The American Review of Public Administration, 40, 654-670. [Google Scholar]
  58. Riccucci N. (2005). How management matters: Street-level bureaucrats and welfare reform. Washington, DC: Georgetown University Press. [Google Scholar]
  59. Smith B. D., Donovan S. E. (2003). Child welfare practice in organizational and institutional context. Social Service Review, 77, 541-563. [Google Scholar]
  60. Social Exclusion Unit. (2002). Reducing re-offending by ex-prisoners. London, England: Crown Publications. [Google Scholar]
  61. Spohn C. (2000). Thirty years of sentencing reform: The quest for a racially neutral sentencing process. Criminal Justice, 3, 427-501. [Google Scholar]
  62. SVG Verslavingsreclassering. (2009). Leefstijltraining voor verslaafde justitiabelen. Deel A: Theoretische en managementhandleiding [Lifestyletraining for addicted offenders. Part A: Theoretical and management instruction]. Utrecht, The Netherlands: Author. [Google Scholar]
  63. Taxman F. S., Bouffard J. A. (2000). The importance of systems in improving offender outcomes: New frontiers in treatment integrity. Justice Research and Policy, 2, 37-58. [Google Scholar]
  64. Taxman F. S., Marlowe D. (2006). Risk, needs, responsivity: In action or inaction? Crime & Delinquency, 52(1), 3-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Taxman F. S., Perdoni M. L., Harrison L. D. (2007). Drug treatment services for adult offenders: The state of the state. Journal of Substance Abuse Treatment, 32, 239-254. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Tummers L., Bekkers V. (2014). Policy implementation, street-level bureaucracy, and the importance of discretion. Public Management Review, 16(4), 527-547. [Google Scholar]
  67. Tummers L. L., Bekkers V., Vink E., Musheno M. (2015). Coping during public service delivery: A conceptualization and systematic review of the literature. Journal of Public Administration Research and Theory, 25, 1099-1126. [Google Scholar]
  68. Ulmer J. T., Bradley M. S. (2006). Variation in trial penalties among serious violent offenses. Criminology, 44, 631-670. [Google Scholar]
  69. Ulmer J. T., Johnson B. (2004). Sentencing in context: A multilevel analysis. Criminology, 42, 137-178. [Google Scholar]
  70. Van der Knaap L. M., Leenarts L. E. W., Born M. P., Oosterveld P. (2012). Re-evaluating inter-rater reliability in offender risk assessment. Crime & Delinquency, 58, 147-163. [Google Scholar]
  71. Van der Linden B. (2004). Terugdringen recidive [The prevention of recidivism program]. Process, 83, 94-101. [Google Scholar]
  72. Wartna B. S. J., Tollenaar N., Blom M., Alma S., Essers A. A. M., Bregman I. M. (2010). Recidivebericht 1997-2007 [Recidivism Report 1997-2007]. Den Haag, The Netherlands: Wetenschappelijk Onderzoek en Documentatie Centrum. [Google Scholar]
  73. Weatherley R. (1979). Reforming special education: Policy implementation from state level to street level. Cambridge, MA: MIT Press. [Google Scholar]
  74. Wenger J. B., Wilkins V. M. (2009). At the discretion of rogue agents: How automation improves women’s outcomes in unemployment insurance. Journal of Public Administration Research and Theory, 19, 313-333. [Google Scholar]
  75. Winfree L. T., Jr., Sellers C. S., Ballard V. S., Roberg R. R. (1990). Responding to a legislated change in correctional practices: A quasi-experimental study of revocation hearings and parole board actions. Journal of Criminal Justice, 18, 195-215. [Google Scholar]
  76. Winter S. (2002, August). Explaining street-level bureaucratic behavior in social and regulatory policies. Paper presented at the annual meeting of the Nordic Political Science Association, Aalborg, Denmark. [Google Scholar]
  77. Zatz M. S. (2000). The convergence of race, ethnicity, gender, and class on court decision making: Looking toward the 21st century. Criminal Justice, 3, 503-552. [Google Scholar]

Articles from Crime and Delinquency are provided here courtesy of SAGE Publications

RESOURCES