Skip to main content

Estimating a treatment effect on recidivism for correctional multiple component treatment for people in prison with an alcohol use disorder in England

Abstract

Background

There is an emerging literature on the impact of correctional substance abuse treatment (SAT) on reoffending for people in prison with substance misuse issues. This study estimates a pathway effect for people in prison receiving multiple component treatments for an alcohol use disorder (AUD) to reduce reoffending by applying treatment effect estimation techniques for observational studies. Treatment groups comprised pharmacological treatments, psychosocial interventions (PSIs) and interventions that incorporate Risk Need Responsivity (RNR) programming. RNR compliant treatment matches treatment dose to the risk of reoffending, targets criminogenic need and is tailored to a person’s learning style.

Methods

Multiple treatment effect estimators are provided for people in prison diagnosed with an AUD in England when compared to a derived control group for: Pharmacological treatment only; RNR compliant treatment and PSIs.

Results

The outcomes for RNR compliant treatment suggest a lower recidivism rate compared to the control group. Pharmacological only treatment results in a statistically significant higher level of reoffending relative to the control group.

Conclusions

The creation of a universal system of ‘equivalence of care’ framed within a public health context in English correctional SAT may have had an unintended consequence of diluting approaches that reduce recidivism. There is an opportunity to develop an integrated, cross-disciplinary model for correctional SAT that unites public health and RNR compliant approaches.

Background

Studies have highlighted the association between violence and alcohol with high prevalence estimates of alcohol use disorders (AUD) noted in correctional settings [19]. International estimates for AUDs among recently incarcerated people in prison are around one-quarter (24%) compared to 30% illicit drug use for males and around half (51%) for females [18]. In England, just under half (48%) of people in prison accessing substance misuse treatment services will have a diagnosed AUD, of which around one in ten (11%) were misusing alcohol only and not illicit drugs [44]. Evaluations of correctional substance abuse treatment (SAT) have suggested positive effects on reoffending through reductions in reoffending rates [8, 21, 39, 40, 42, 52, 56]. These positive findings have also been demonstrated for AUD clients in community treatment [55] although poorer outcomes relative to illicit drug misusers have been noted [22]. Although there is a sizeable literature on SAT in correctional settings whereby treatment for AUDs has been integrated within interventions addressing illicit drug misuse, there is relatively little known on the effectiveness of correctional treatment for people in prison who present with alcohol issues only. Commentators have argued that there is a need to focus on outcomes for drinkers which has been considered an overlooked area in treatment effectiveness research [17, 22].

In England, correctional SAT encompasses a variety of treatment styles and philosophies offered to differing offender segments. The UK Government’s Drug Strategy [25] emphasised offenders’ access to SAT at all stages of the criminal justice system with an explicit aim to reduce reoffending [38]. The National Health Service (NHS) supports English community and correctional SAT. Implicit in this framework is the concept of ‘equivalence of care’ across correctional and community SAT based on the principle of universality, where any person in prison is entitled to access the same treatment in correctional settings as in the community. Despite this aim, inconsistencies in achieving equivalence of care have been noted due to the increased size and complexity of the prison population, alongside the effects of austerity on resourcing [28].

Although correctional SAT is conceptualised as a single treatment system, there are a number of multicomponent interventions including pharmacological treatments that manage symptoms of withdrawal (acamprosate, disulfiram or naltrexone). Access to prison-based SAT can occur across jurisdictions through a medical assessment of alcohol-related needs including severity of consumption, and a criminal behavioural assessment by offender managers who refer onwards to SAT if problematic use has been identified. The approach to delivering SAT is underpinned by national guidelines on clinical management [14, 37].

Historically in English correctional settings, interventions were developed using structured (or ‘manualised’) group programs incorporating Risk Need Responsivity (RNR) components [2]. Andrews and Bonta [1] have highlighted the three principles underpinning effective treatment programs aimed at offender rehabilitation. The first principle focuses on an offender’s likelihood of offending risk, such that higher-risk offenders are required to receive more intensive (higher ‘dose’) interventions. The second facet is to address the criminogenic and non-criminogenic needs of an offender. These are subdivided into static (age, gender, ethnicity, offending history) and dynamic factors (motivation, attitude to authority etc.). The final component is ‘responsivity’ including ‘general’ responsivity that posits cognitive-behavioural interventions are more efficacious than nonbehavioral approaches [2]. Interventions that incorporate these components will be defined as ‘RNR compliant’ treatment. The combination of pharmacological treatment and psychosocial interventions (PSIs) are provided within each prison across England with an emphasis on establishing a therapeutic alliance between therapist and client through evidence-based practices including cognitive behavioural therapies that focus on alcohol consumption that trigger criminal behaviours [14]. Behavioural programs for offenders have been largely decommissioned, replaced by a range of PSIs including one-to-one cognitive therapies and structured group work with peer or mutual aid support offered where possible [54]. PSIs are less likely to be focused on the offence (e.g. violent behaviour or drink-driving) but rather address remission by tackling alcohol-related cognitions and its relationship to criminal behaviour. These interventions will not be primarily based on RNR principles and therefore will be classified as ‘PSIs’.

The aim of the study is to estimate a treatment effect on recidivism for multiple component treatment for people in prison with an AUD in England. The components of SAT to reduce recidivism will be compared to each other and to a control group. This excludes those who use illicit drugs and focuses on AUD needs only. The analysis will estimate a treatment effect for three interventions: pharmacological treatment, RNR compliant and other PSIs. The paper will contribute to the literature of estimation of treatment effectiveness in the context of observational studies, by utilising regression-based methods to estimate the effect of multiple treatment. Few studies have been able to determine a treatment effect where there are competing interventions, thereby limiting any explanation underpinning the efficacy of a single treatment system or program [51].

Methods

Data for this study were derived from an administrative dataset of 59,150 adult prison leavers (aged 18 or more years) in England released into the community during 2013–14. Reconviction data was collected on each prisoner during 2014–15 and separately incorporated into the dataset. Data on prison leavers were linked to the National Drug Treatment Monitoring System (NDTMS) a public health surveillance system used in the community and in prison settings. Where multiple records of a treatment episode existed, the one nearest to the date of release from prison was chosen. A total of 2647 people in prison (10%) reported to NDTMS as having received treatment for an AUD and released during 2013–14 were matched with the prison leavers dataset using a common unique identifier (‘NOMSID’). People in prison identified as having an AUD but not known to NDTMS and therefore not exposed to prison-based SAT were considered part of the control group (n = 24,007).

The possibility of whether any people in prison reported within the control group had received AUD treatment (for example, not recorded due to data entry error) was examined through combining the unique ID match with ‘fuzzy logic’ linkages based on personal identifiers held across both datasets (initials, date of birth and gender). An initial run generated around 8000 possible matches but adjusting the logic to ‘likely’ characteristics (e.g. gender, ethnicity, home location) matched to the same prison and time period generated 166 possible matches (1%) where a person may have received AUD treatment. Sensitivity tests using the single and enhanced matches generated very similar outcomes and therefore the unique identifier match was used as the final analytical method.

Details on the treatment received are captured on NDTMS and included within a ‘modality’ variable [45]. Here interventions are categorised using broad headings such as ‘pharmacological interventions’ for pharmacological treatment, and five interventions that are grouped under a wider PSI heading. These include ‘counseling’; ‘cognitive behavioural therapy’; ‘motivational interviewing’; ‘relapse prevention’ and ‘family work’. An initial exploration of these groupings found that people in prison received a number of PSIs in combination over one episode of treatment. As there were multiple and disparate therapies, these were grouped into a single PSI component to boost sample size. 241 (9%) people in prison were coded as receiving RNR compliant treatment in that they were categorised as high-risk offenders receiving the most intensive treatment dose (dosage was calculated as the length of treatment for that treatment episode coded into tertiary bands of low-medium-high levels) whilst also receiving one of the five evidence-based PSIs highlighted above. Seven hundred thirty three people in prison (28%) received pharmacological treatment only with no PSI input and 1673 (63%) people in prison received PSIs.

Participants

A summary of the crude (unadjusted) characteristics by socio-demographic and offending details of the control and treatment groups is presented in Table 1. The offence data show the mean number of offences for people in prison by control or treatment group, alongside the mean length of stay (spell length) in prison for each group.

Table 1 Unweighted characteristics of the control and treatment groups

Outcome measure

A binary definition of reoffending (yes/no) for people in prison released during 2013–14 was calculated from the Police National Computer that included any individual with at least one instance of being recorded as convicted, cautioned, reprimanded or warned, but excluded Penalty Notices for Disorder, in a one-year period after release from prison and appended to the dataset [35].

Statistical models

Two explicit assumptions are required to establish a treatment effect for an intervention made in the context of an observational study. The first is to adjust for as many confounders as possible that are associated with treatment assignment and with the outcome. A second is for there to be complete ‘overlap’ in the distribution of prognostics across treatment modalities. When these conditions have been fulfilled then there is ‘strong ignorability’ of how an individual came to be treated relative to the outcome [46]. Rosenbaum and Rubin [46] established a propensity score structure for binary treatment which has been deployed to minimise selection bias [27, 32]. Methodologies encompassing regression models and inverse probability weighting have been developed for the evaluation of multiple treatments [33]. A treatment effect will be assessed using four alternative methods: regression adjustment (RA), inverse probability weighting (IPW), augmented inverse probability weighting (AIPW) and inverse probability weighted regression adjustment (IPWRA).

All four methods yield two sets of estimated quantities: a set of model-based predicted means for each treatment group (known as Potential Outcome Means), which are then compared to find a set pairwise differences between treatment group means (termed Average Treatment Effect). As the outcome measure is binary, predicted treatment means can be interpreted as predicted probabilities of reoffending in each group and their pairwise differences can be interpreted as risk differences.

The RA method first models the reoffending outcome (on a set of prognostics), separately for each treatment, then predicts the probability of reoffending for all subjects in the database, all assigned to each treatment in turn, and averages individual predictions by treatment group. The RA method does not model the treatment assignment. The IPW method first models the treatment assignment (on a set of prognostics), then predicts the probability of treatment assignment for each subject in the database and computes the inverse of these probabilities (termed Inverse Probability Weights, or IPW). The latter are then used when predicting the reoffending outcome for each subject in the database, according to their assigned treatment only, and averages individual predictions by treatment group. The IPW method does not model the reoffending outcome.

The remaining two methods also first model treatment assignment for deriving inverse probability weights as described above, though these weights are used at different stages. The AIPW method models the reoffending outcome, separately for each treatment, then predicts the probability of reoffending for all subjects in the database, all assigned to each treatment in turn, adjusts such predictions using inverse proportional weights as a correction factor, and finally averages individual predictions by treatment group. The IPWRA method differs only in that it uses inverse probability weights when modelling the reoffending outcome, and not as a correction factor of the model-based predictions. So both the AIPW and IPWRA methods are said to be ‘doubly-robust’ because they explicitly model both the treatment assignment and the reoffending outcome; their estimates will be consistent even when either the treatment model or the outcome model (but not both) are mis-specified. Doubly robust methods are considered the most efficient at estimating treatment effects for multiple treatment in observational studies [33].

Prognostic variables

Information held on prison leavers included socio-demographic details, release dates and spell length. It should be noted that ethnic group is not included in this dataset, rather using a wider ‘nationality’ definition. Preliminary analysis suggested large levels of missing or incomplete data resulting in this variable being dropped from the final analysis. In the UK, criminogenic risk is measured by the Offender Group Reconviction Scale 3 (OGRS), which is an actuarial tool established to predict general reoffending and is administered to all adult prisoners across England and Wales [26]. It incorporates three static risk factors (age, gender and offending history) to derive the likelihood of reoffending 1–2 years from prison discharge and has been shown to achieve a high level of predictive accuracy [26]. OGRS scores are broken down into low, medium, high/very-high risk categories. Use of OGRS scores have been incorporated within a wider Offender Assessment System (OASys) that integrates actuarial risk with dynamic and static risk factors including details of the offence, housing, employment/education/training, financial, relationship, lifestyle/associates, drug and alcohol, emotional well-being, thinking and behaviour, attitudes and general health needs. These components have been used in quasi-experimental studies creating matched control samples [9, 47]. All adult people in prison were assessed for an AUD by the prisoner’s offender manager. If the prisoner’s alcohol consumption was explicitly linked to offending and/or severity of use prior to incarceration was significant, then an AUD was recorded. Severity of alcohol consumption was determined on an ordinal scale with the highest-level equivalent to dependency. Out of 59,150 prison leavers, 26,654 people in prison (45%) were identified as having an AUD.

Characteristics of the baseline sample were determined through a number of static and dynamic prognostic variables derived from the merged dataset. These included socio-demographics (age, gender), offending history, length of prison spell and dynamic variables derived from the OASys actuarial risk assessment including emotional well-being, temper and control, problem solving skills, awareness of criminal consequences, general health status, whether unemployed, access to prosocial activities, illicit drug use, alcohol consumption linked to offending and levels of binge drinking.

Covariate balance

Designed studies in which treatments are allocated according to a randomisation schedule are considered to yield unbiased treatment effect estimates, as treated and control groups are considered equivalent across subjects’ characteristics [10]. However, in observational studies treatment selection is often influenced by subject characteristics, resulting in systematic differences in baseline characteristics between subjects in the treated and control groups [48, 49]. The lack of random treatment allocation has been shown to yield biased treatment effect estimates [5]. A key requirement of analytical techniques for estimating treatment effect in observational studies is therefore to try re-balance the subjects’ characteristics between groups being compared, termed “covariate balance”. As regression adjustment does not use weights to derive an estimate and the other estimates use the same weights, only one covariate summary is required for balancing. The extent to which the weighting method achieves covariate balance was assessed visually using the approach recommended by Austin and Stuart [4]. Their suggestion is to illustrate absolute mean standardised differences between covariates in each treatment group relative to the control group, both before (“raw”) and after (“weighted”) the weighting process. Ideally, all symbols of the weighted absolute mean standardised differences would be aligned above the value of zero on the horizontal axis. For pharmacological treatment (Fig. 1), three variables (gender, employment related to offending and offence) were unbalanced after weighting. For the RNR compliant group (Fig. 2), five covariates (offence, employment linked to offending, previous convictions, previous prison events and temper control) were less balanced after weighting than before it, very likely due to the small samples size of this group. Figure 3 shows two prognostics (lifestyle and previous convictions) less balanced after weighting than before it for the PSI group. Sensitivity tests were run removing the unbalanced variables which showed no difference in outcomes.

Fig. 1
figure 1

Covariate Balance for Pharmacological Treatment compared to control group. Legend: Dots represent raw or weighted data. Diamonds represent weighted data

Fig. 2
figure 2

Covariate Balance for RNR compliant Treatment compared to control group. Legend: Dots represent raw or weighted data. Diamonds represent weighted data

Fig. 3
figure 3

Covariate Balance for PSI Treatment compared to control group. Legend: Dots represent raw or weighted data. Diamonds represent weighted data

Results

Table 2 presents the crude reconviction rates for the treated and control populations using the derived treatment modalities. RNR compliant treatment recorded the lowest rate of reoffending (36.5%) of all treatment modalities, i.e., pharmacological treatment (53.8%) and PSIs (40.2%), and also showing reoffending rates lower than the untreated group (43.7%).

Table 2 Unweighted reoffending rates of people in prison receiving SAT treatment and control group

Table 3 examines the treatment effect for each treatment modality using the four models. As expected, the larger the sample size, the less variability in the estimated reoffending rate, which was noticeable for the control group. Different methods yielded similar estimates for each treatment modality, except for the IPWRA method, which for RNR compliant treatment yielded an estimate of 0.756 compared to a range of 0.342 to 0.417 from the other three methods. A diagnostic look at the coefficients from the logistic regression models in the RNR compliant treatment revealed a malfunction called ‘convergence failure’ [3] in both the model for the reoffending outcome and for the treatment allocation. Therefore, the predicted reoffending rate of 0.756 for the RNR compliant group from the IPWRA method was deemed an unreliable estimate, with it being the highest of the four groups being compared and more than twice its crude rate of 0.365. Instead, across the other three methods (AIPW, IPW and RA) exposure to RNR compliant treatment consistently yielded the lowest estimated re-offending rate of all four groups compared.

Table 3 Weighted Treatment Effects (Potential Outcome Means) of people in prison receiving multiple component treatment compared to a control group by treatment effect estimator

Table 4 presents the risk differences between predicted reoffending rates for all treatment modalities, by each estimation method. We did not interpret the results for the RNR compliant group from the IPWRA method, given the malfunction of its underlying logistic regression model. 99% coverage was needed to yield a set of 95% simultaneous confidence intervals [11]. A single-step Bonferroni adjustment for multiplicity was applied to p-values from z-tests [20]. The RA method, which unlike the other three methods does not use a weighting scheme, yielded no statistically significant result among the six risk differences. Results from the other three methods suggested an overall higher reoffending rate of the pharmacological treatment only group compared to the control group, with a statistically significant effect from both AIPW method (p-value = 0.0279, risk difference = 0.092, 95% CI [0.008, 0.0176]) and IPWRA method (p-value = 0.0369, risk difference = 0.079, 95% CI [0.005, 0.154]). Only the IPW method yielded a statistically significant reduction in reoffending rate for the RNR compliant group compared to the pharmacological treatment only group (p-value = 0.0072, risk difference = 0.188, 95% CI [0.039, 0.339]). Despite the reoffending rate for the RNR compliant group being the lowest estimate for all four groups also from the RA and AIPW methods, the latter did not yield significant risk differences between the RNR compliant group and any other group. This result can be explained by the small sample size of the RNR compliant group being the limiting factor for the precision of its estimates.

Table 4 Pairwise risk differences (Average Treatment Effect), Bonferroni adjusted across multiple treatments and comparison group, by estimating method

Discussion

This study assesses a treatment effect on recidivism as measured by post-treatment reconviction rates for multiple component correctional SAT. SAT was divided into three groups relating to pharmacological treatment only (28%), RNR compliant treatment (9%) and PSIs (63%). The weighted reoffending rates for people in prison treated for an AUD-only was estimated to be between 34 and 42% which is lower than the 48% overall offending rates for adults released from custody [36].

Using methods for estimating a multivalued treatment effect from an observational study, it was possible to establish that RNR compliant approaches reported lower offending rates than the control group. Other treatments including PSI and pharmacological only approaches did not reduce offending rates relative to the control group. This study adds to the wider literature on a treatment effect on recidivism for substance misusers. Systematic reviews [13, 15] suggest that for any substance misused (illicit drugs and alcohol) some treatment types can realise significant reductions in recidivism. However, direct comparisons to other studies are difficult due to the heterogeneity of populations measured methods used, varying definitions of recidivism and sample attrition [15].

The study also finds that pharmacological only treatment for an AUD leads to a significant increase in reoffending relative to the control group. This is contrary to the findings from a systematic review [13] that found the majority of pharmacological interventions for substance misusers were likely to report reductions in reoffending. This may be in part explained by differing methodological approaches, but this study suggests that use of pharmacological only treatment is likely to be an unintended consequence of operationalising SAT within an English correctional setting. Guidance suggests that PSIs should be delivered alongside pharmacological treatment [14]. People in prison receiving a short sentence or housed for a short spell, the availability of PSIs and an emphasis on treating the health-related consequences of alcohol consumption may have resulted in PSIs not being delivered despite services’ best intentions. It is also likely that receipt of pharmacological treatment-only reflected the severity of alcohol-related needs that required a clinical response prior to any cognitive behavioural work. This has implications for the findings as we suggest that addressing this unintended consequence, by sequencing PSIs into SAT may have a positive effect on reconviction rates.

Therefore, we suggest that the principle of treatment ‘equivalence of care’ has reframed English correctional SAT towards delivering health-based approaches commensurate to community-based treatment. Structured programs and interventions designed on RNR programming principles have been subsumed within more health-focused approaches. Guidance documents have emphasized medical management with the assumption that “drug treatment significantly reduces drug-related crime” ([14]; 13). The universal principle of ‘equivalence of care’ has made operationalising a national system treatment system that incorporates risk of offending within a medicalised model of treatment to be highly problematic. Studies in the UK on smaller scale offender behavioural programs found difficulties in ensuring risk was adequately calibrated to need and dosage [24]. As PSIs become focused on managing relapse or minimising the harm from excessive alcohol consumption, there is a likely dilution of an effect on reoffending [16, 43]. PSIs form part of the therapeutic delivery model but these interventions are often not delivered due to the difficulties of operationalising interventions in a correctional setting [28]. Contextually, [29] [30]) extend this argument to suggest that the prisons operate with a command-and-control, hierarchical management structure and an overarching suspicion of public health approaches will also further limit the ambition of delivering genuine equivalence of care in prison healthcare.

The deployment of RNR principles has also been shown to be problematic where multiple treatments coexist. Operationalising severity of substance misuse to encompass dependence and how consumption changes over time has been shown to be challenging [50]. The low number of RNR compliant interventions may be a reflection of the difficulty of operationalising this approach in correctional settings. Marlowe [34] argues that treating both non-dependent and low-risk substance misusers may also dilute a treatment effect on recidivism. The delivery of treatment within correctional settings has also been viewed as problematic as few people in prison may access the treatment they need, using non-evidence based interventions such as group-based drug education [41] and what interventions are available may be delivered poorly [34]. Evidence from English criminal justice settings suggest that the majority of PSIs are limited in scope with little therapeutic contact, focusing on administrative functions [6, 7].

There is also a suggestion that some substance misuse practitioners are resistant to treating high-risk people in prison as they are more likely to be disruptive and lack motivation to change [51]. Critics also argue that prison-based treatment will include people in prison with tangential needs (i.e. involvement in activities relating to the production or supply of substances or with high rates of co-occurring disorders including suicidal thoughts, anxiety and depression, and generally in poor physical health). Clinical screening tools may also overstate the need for treatment by focusing on a prisoner’s immediate severity of use, and the role of self-selection through self-referrals or court-mandated treatment creating selection biases [31]. Despite these challenges, correctional treatment for AUDs provides an opportunity for breaking the cycle of substance misuse and offending if effectively planned and integrated across health and criminal justice jurisdictions. Integrating approaches across offender managers and public health can also enhance the detection and diagnosis of alcohol-related needs. This can create improved treatment pathways that can reduce the likelihood of people in prison with an AUD receiving pharmacological only treatment. More depth is also required to understand the relationship between reoffending and relapse [43]. A focus on a single measurement (reoffending) is unlikely to give a full picture of a treatment effect. More quantitative work is required to situate changes in offending patterns post release with other clinical or recovery-orientated measures [53].

The evidence from this study suggests there is an opportunity to address the issues underpinning the delivery models to develop an integrated public health and criminal justice-orientated approach that merges pharmacological treatment with RNR principles into a coherent, unified treatment system. We suggest that correctional treatment for AUDs should not be seen in binary public health or criminal justice terms, rather there is a need to enhance treatment models to deliver evidence-based practice for to support both clinical and crime reduction needs. We further suggest extending this approach to assessing a treatment effect for illicit drug misusers in prison, and for people in prison who misuse illicit drugs and alcohol in combination.

Strengths and limitations

This study examines the effectiveness of multiple treatment systems in reducing recidivism for people in prison who have been diagnosed with AUD. The value of this study is that it simultaneously compares treatments to each other and to a control group using methods developed for estimating a multicomponent treatment effect from an observational study. The multiple treatment and control groups have been shown to be better balanced after reweighting using these methods (Figs. 1, 2 and 3). The study also has a national geographic focus (England) and includes large sample sizes. However, some limitations should be noted. Firstly, there is limited information available on the detail within each treatment component, what the intervention comprised of, when it was delivered and how relevant it was to their needs. It is likely that broad categorisations do not capture the nuance of the treatment experience in each prison [12]. Moreover, the categorisation of RNR compliant treatment was likely a coding construct as the treatment system did not specifically code for this intervention. Although this will include some specifically designed RNR programs [23] it is also likely that some of the people in prison accessing treatment will be unaware that are receiving RNR treatment. Second, while alcohol severity was determined, the scales used were not validated tools. Covariate balance was achieved by measuring how strongly alcohol use was associated with reoffending. More sophistication of measuring differential levels of severity is required to ensure the treatment groups are balanced effectively.

The study has explored the use of regression-based methods for estimating treatment effect on recidivism rates in an observational study context. It is of note that one of the “doubly-robust” methods did not work as anticipated, contrary to what was expected in recent methodological literature [33]. This study has suggested that caution is advised in presence of groups with relatively small sample sizes. The small sample size of the RNR group caused its multinomial logistic model of the IPWRA method to malfunction, yielding an estimated recidivism rate much higher than its observed crude rate. Such malfunction may be avoided by gathering a larger sample size in the problem group, but this being an observational study, group sample sizes were fixed. The problem was examined by comparing results from across the four statistical analysis methods deployed. It is therefore recommended that similar studies should report results from a range of statistical methods. This will minimise the risk of relying on estimates from a single modelling technique, which may be revealed as unreliable only when compared to estimates of the same quantity from other similar techniques. Consequently, we recommend that future work should routinely report on a range of estimated rates resulting from using more than one statistical methodology. The outcome measure for this study is binary (whether a person offended or not) and lacks a nuanced understanding of differential levels of reoffending by offence type. It is possible for example, that changes were noted by type of crime committed. Further work is required to develop multimodal outcome measurements that include change in the nature and severity of offence committed. Finally, although offender programming was decommissioned, it is possible that the control group may have received some legacy interventions for their wider offending needs, although it is anticipated that this number would be small. Consequently, these subjects may have had a non-substance misuse specific treatment effect on reducing recidivism.

Conclusion

The modelling of the effect of each treatment component suggests that RNR compliant treatment could be the most effective intervention compared to other treatments. RNR compliant treatment was the only intervention arm that, except for one method (IPWRA), consistently yielded the lowest estimated rate of reoffending of all groups being compared. However, in contrast, pharmacological only interventions demonstrated statistically significant negative results (i.e. increased rate of reoffending) compared to the control group which may be attributed to the unintended consequence of establishing equivalence of care in custodial settings with community services. It is suggested that prioritisation of equivalence of care has emphasized pharmacological interventions sometimes at the expense of an integrated approach that incorporates use of PSIs. There is an opportunity to develop an integrated approach to meeting the needs of people in prison with an AUD in ensuring an equitable public health and criminal justice response.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available as they are owned by the Ministry of Justice and Public Health England and is considered restricted information.

Abbreviations

AIPW:

Augmented inverse probability of treatment weighting

ATE:

Average treatment effect

AUD:

Alcohol use disorder

CBT:

Cognitive behavioural therapy

IPW:

Inverse probability of treatment weighting

IPWRA:

Inverse probability of treatment weighted regression adjustment

NDTMS:

National Drug Treatment Monitoring System

NHS:

National Health Service

OASys:

Offender Assessment System

OGRS:

Offender Group Reconviction Scale

PSI:

Psychosocial interventions

RA:

Regression adjustment

RNR:

Risk Need Responsivity

SAT:

Substance abuse treatment

References

  1. Andrews DA, Bonta J. The psychology of criminal conduct. New York: Routledge; 2010.

  2. Andrews DA, Zinger I, Hoge RD, Bonta J, Gendreau P, Cullen FT. Does correctional treatment work? A clinically relevant and psychologically informed meta-analysis. Criminology. 1990;28(3):369–404.

    Article  Google Scholar 

  3. Allison PD. Convergence failures in logistic regression. SAS Global Forum. 2008;360:1–11.

    Google Scholar 

  4. Austin PC, Stuart EA. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Stat Med. 2015;34(28):3661–79.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Austin PC. The performance of different propensity score methods for estimating marginal odds ratios. Stat Med. 2007;26(16):3078–94.

    Article  PubMed  Google Scholar 

  6. Best D, Wood K, Sweeting R, Morgan B, Day E. Fitting a quart into a black box: Keyworking in quasi-coercive drug treatment in England. Drugs: Education Prev Pol. 2010;17(4):370–87.

    Google Scholar 

  7. Best D, Day E, Morgan B, Oza T, Copello A, Gossop M. What treatment means in practice: an analysis of the delivery of evidence-based interventions in criminal justice drug treatment services in Birmingham, England. Addiction Res Theory. 2009;17(6):678–87.

    Article  Google Scholar 

  8. Blatch C, O'Sullivan K, Delaney JJ, Rathbone D. Getting SMART, SMART recovery© programs and reoffending. J Forensic Pract. 2016;18(1):3–16.

    Article  Google Scholar 

  9. Bloomfield S, Dixon L. An outcome evaluation of the integrated domestic abuse programme (IDAP) and community domestic violence programme (CDVP)See https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/449008/outcome-evaluation-idap-cdvp.pdf (last Accessed 17 July 2017); 2015.

    Google Scholar 

  10. Bowes N, McMurran M, Evans C, Oatley G, Williams B, David S. Treating alcohol-related violence: a feasibility study of a randomized controlled trial in prisons. J Forensic Psychiatry Psychol. 2014;25(2):152–63.

    Article  Google Scholar 

  11. Chen T, Hoppe FM. Simultaneous Confidence Intervals. In Wiley StatsRef: Statistics Reference Online (eds N. Balakrishnan, T. Colton, B. Everitt, W. Piegorsch, F. Ruggeri and J.L. Teugels). 2014; https://0-doi-org.brum.beds.ac.uk/10.1002/9781118445112.stat05961.

  12. Davidson KM, Young JT. Treatment engagement in a prison-based therapeutic community: a mixed-methods approach. J Subst Abuse Treat. 2019;103:33–42.

    Article  PubMed  Google Scholar 

  13. de Andrade D, Ritchie J, Rowlands M, Mann E, Hides L. Substance use and recidivism outcomes for prison-based drug and alcohol interventions. Epidemiol Rev. 2018;40(1):121–33.

    Article  PubMed  Google Scholar 

  14. Department of Health. Drug misuse and dependence: UK guidelines on clinical management. London: Department of Health; 2017.

    Google Scholar 

  15. Doyle MF, Shakeshaft A, Guthrie J, Snijder M, Butler T. A systematic review of evaluations of prison-based alcohol and other drug use behavioural treatment for men. Aust N Z J Public Health. 2019;43(2):120–30.

    Article  PubMed  Google Scholar 

  16. Farabee D. Current and promising pharmacotherapies for substance use disorders among justice-involved populations. Eur J Crim Policy Res. 2018;24(2):145–53.

    Article  Google Scholar 

  17. Farabee D, Prendergast M, Cartier J. Alcohol & drug abuse: alcohol, the" un-drug". Psychiatr Serv. 2002;53(11):1375–6.

    Article  PubMed  Google Scholar 

  18. Fazel S, Yoon IA, Hayes AJ. Substance use disorders in prisoners: an updated systematic review and meta-regression analysis in recently incarcerated men and women. Addiction. 2017;112(10):1725–39.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Fazel S, Hayes AJ, Bartellas K, Clerici M, Trestman R. Mental health of prisoners: prevalence, adverse outcomes, and interventions. Lancet Psychiatry. 2016;3(9):871–81.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Frane AV. Are per-family type I error rates relevant in social and behavioral science? J Mod Appl Stat Methods. 2015;14(1):5.

    Article  Google Scholar 

  21. Friedmann PD, Green TC, Taxman FS, Harrington M, Rhodes AG, Katz E, et al. Collaborative behavioral management among parolees: drug use, crime and re-arrest in the Step'n out randomized trial. Addiction. 2012;107(6):1099–108.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Gossop M. The National Treatment Outcomes Research Study (NTORS) and its influence on addiction treatment policy in the United Kingdom. Addiction. 2015;110:50–3.

    Article  PubMed  Google Scholar 

  23. Hamilton L, Koehler JA, Lösel F. Treatment Programmes for substance abusing offenders in Europe: a survey of routine practice. Eur J Crim Policy Res. 2015;21(3):371–84.

    Article  Google Scholar 

  24. Hollin CR, McGuire J, Hounsome JC, Hatcher RM, Bilby CA, Palmer EJ. Cognitive skills behavior programs for offenders in the community: a reconviction analysis. Crim Justice Behav. 2008;35(3):269–83.

    Article  Google Scholar 

  25. HM Government. 2017 drug strategy; 2017.

    Google Scholar 

  26. Howard P, Francis B, Soothill K, Humphreys L. OGRS 3: the revised offender group reconviction scale. London: Ministry of Justice; 2009.

    Google Scholar 

  27. Imbens GW. The role of the propensity score in estimating dose-response functions. Biometrika. 2000;87(3):706–10.

    Article  Google Scholar 

  28. Ismail N, De Viggiani N. How do policymakers interpret and implement the principle of equivalence with regard to prison health? A qualitative study among key policymakers in England. J Med Ethics. 2018a;44(11):746–50.

    Article  PubMed  Google Scholar 

  29. Ismail N, De Viggiani N. Should we use a direct regulation to implement the healthy prisons agenda in England? A qualitative study among prison key policy makers. J Public Health. 2018b;40(3):598–605.

    Article  CAS  Google Scholar 

  30. Ismail N, de Viggiani N. Challenges for prison governors and staff in implementing the healthy prisons agenda in English prisons. Public Health. 2018;162:91–7.

    Article  CAS  PubMed  Google Scholar 

  31. Jolley JM, Kerbs JJ. Risk, need, and responsivity: unrealized potential for the international delivery of substance abuse treatment in prison. Int Criminal Justice Rev. 2010;20(3):280–301.

    Article  Google Scholar 

  32. Lechner M. Identification and estimation of causal effects of multiple treatments under the conditional independence assumption. In: Econometric evaluation of labour market policies. Heidelberg: Physica; 2001. p. 43–58.

    Chapter  Google Scholar 

  33. Linden A, Uysal SD, Ryan A, Adams JL. Estimating causal effects for multiple treatments: a comparison of approaches. Stat Med. 2016;35(4):534–52.

    Article  PubMed  Google Scholar 

  34. Marlowe DB. Evidence-based policies and practices for drug-involved offenders. Prison J. 2011;91(3_suppl):27S–47S.

    Article  Google Scholar 

  35. Ministry of Justice. Proven re-offending statistics: definitions and measurement. London: Ministry of Justice; 2011.

    Google Scholar 

  36. Ministry of Justice. Proven reoffending statistics quarterly bulletin, January 2017 to march 2017. London: Ministry of Justice; 2019.

    Google Scholar 

  37. National Collaborating Centre for Mental Health (Great Britain), National Institute for Health, Clinical Excellence (Great Britain). Alcohol use disorders: The NICE guideline on the diagnosis, assessment and management of harmful drinking and alcohol dependence. RCPsych Publications: London; 2011.

  38. NHS England. Service specification integrated substance misuse treatment service prisons in England. London: NHS England; 2018.

    Google Scholar 

  39. Olson DE, Lurigio AJ. The long-term effects of prison-based drug treatment and aftercare services on recidivism. J Offender Rehabil. 2014;53(8):600–19.

    Article  Google Scholar 

  40. Palmer E, Hatcher R, McGuire J, Bilby C, Ayres T, Hollin C. Evaluation of the addressing substance-related offending (ASRO) program for substance-using offenders in the community: a reconviction analysis. Subst Use Misuse. 2011;46(8):1072–80.

    Article  PubMed  Google Scholar 

  41. Pearson FS, Lipton DS. A meta-analytic review of the effectiveness of corrections-based treatments for drug abuse. Prison J. 1999;79(4):384–410.

    Article  Google Scholar 

  42. Porporino FJ, Robinson D, Millson B, Weekes JR. An outcome evaluation of prison-based treatment programming for substance users. Subst Use Misuse. 2002;37(8–10):1047–77.

    Article  PubMed  Google Scholar 

  43. Prendergast ML, Pearson FS, Podus D, Hamilton ZK, Greenwell L. The Andrews’ principles of risk, needs, and responsivity as applied in drug treatment programs: meta-analysis of crime and drug use outcomes. J Exp Criminol. 2013;9(3):275–300.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Public Health England. Alcohol and drug treatment in secure settings 2018 to 2019: report. London: Public Health England; 2020.

    Google Scholar 

  45. Public Health England, National Drug Treatment Monitoring System Young people’s drug and alcohol secure settings business definitions. Core data set P. London: Public Health England; 2019.

    Google Scholar 

  46. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70(1):41–55.

    Article  Google Scholar 

  47. Sadlier G. Evaluation of the impact of the HM prison service enhanced thinking skills programme on reoffending. Outcomes of the surveying prisoner crime reduction (SPCR) sample. England: Ministry of Justice; 2010.

    Google Scholar 

  48. Shadish WR, Cook TD, Campbell DT. In: Shedish WR, Cook TD, Campbell DT, editors. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin; 2002.

    Google Scholar 

  49. Sweeten G. Propensity score matching and prevention science. In: Preventing crime and violence. Cham: Springer; 2017. p. 187–202.

    Chapter  Google Scholar 

  50. Taxman FS, Thanner M, Weisburd D. Risk, need, and responsivity (RNR): It all depends. Crime Delinq. 2006;52(1), 28–51.

  51. Thanner MH, Taxman FS. Responsivity: the value of providing intensive services to high-risk offenders. J Subst Abuse Treat. 2003;24(2):137–47.

    Article  PubMed  Google Scholar 

  52. Turley A, Thornton T, Johnson C, Azzolino S. Jail drug and alcohol treatment program reduces recidivism in nonviolent offenders: a longitudinal study of Monroe County, New York’s, jail treatment drug and alcohol program. Int J Offender Ther Comp Criminol. 2004;48(6):721–8.

    Article  PubMed  Google Scholar 

  53. Van Roeyen S, Anderson S, Vanderplasschen W, Colman C, Vander Laenen F. Desistance in drug-using offenders: a narrative review. Eur J Criminol. 2017;14(5):606–25.

    Article  Google Scholar 

  54. Wheatley M. Promoting recovery in prison – the Holme house approach. Prison Service J. 2019;242:11–7.

    Google Scholar 

  55. Willey H, Eastwood B, Gee IL, Marsden J. Is treatment for alcohol use disorder associated with reductions in criminal offending? A national data linkage cohort study in England. Drug Alcohol Depend. 2016;161:67–76.

    Article  PubMed  Google Scholar 

  56. Zanis DA, Mulvaney F, Coviello D, Alterman AI, Savitz B, Thompson W. The effectiveness of early parole to substance abuse treatment facilities on 24-month criminal recidivism. J Drug Issues. 2003;33(1):223–35.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank colleagues at Public Health England and the Ministry of Justice. The findings from this study do not necessarily reflect the views or stated position of Public Health England or Ministry of Justice.

Funding

The study was funded by Public Health England. The funder provided for access to data only and was not involved in the study design, analysis and interpretation of the data.

Author information

Authors and Affiliations

Authors

Contributions

AS designed the study; manipulated; analysed; interpreted the data and prepared the manuscript; SL contributed to the study design, supported the analysis and interpretation of the data, and preparation of the manuscript; DB supported the interpretation of the data, and in preparing the manuscript. The authors have read and approved the final manuscript.

Corresponding author

Correspondence to Arun Sondhi.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ministry of Justice and Public Health England’s respective legal teams to ensure adherence to Data Protection Act, 1998 principles, in addition to sign-off from PHE’s Caldecott Guardian and the Office for Data Release. The study was also approved by Middlesex University ethics number 1555.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sondhi, A., Leidi, A. & Best, D. Estimating a treatment effect on recidivism for correctional multiple component treatment for people in prison with an alcohol use disorder in England. Subst Abuse Treat Prev Policy 15, 81 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s13011-020-00310-5

Download citation

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13011-020-00310-5

Keywords