Arguments about Methods in Criminal Justice Evaluation

Abstract

The chapter considers the change of position of the Home Office on the value of randomised controlled trials (RCTs) in England and Wales which took place around 2003 after the end of the Crime Reduction Programme (CRP). Before the CRP Home Office researchers had shown little interest in RCTs; after it, they came close to arguing that no other kinds of evaluation research were worth doing. This represented a reversal of a position that had dominated Home Office thinking on the issue for almost 30 years – that RCTs were in general impractical and unlikely to produce clear-cut results. This view was based in part on the experience of RCTs in the 1970s, which led influential researchers to conclude that the method could not be transferred from medicine to criminal justice. But, disappointed with the lack of definite results from the CRP, the Home Office turned back to RCTs as a potential source of certainty about what works. The chapter considers two recent scholarly exchanges on the question, in relation to an evaluation of a community crime reduction programme, for which an experimental design was attempted but not achieved, and to Lawrence Sherman's recent advocacy of RCTs and his use of research on restorative justice as an example of the successful use of the method. The chapter argues that the restorative justice research, while of very high quality, does not provide as clear an example of the use of an RCT as Sherman claims, and concludes with some reflections on the inherent difficulties of criminal justice evaluation, and on the lack of a predictable, rational relationship between research quality and policy influence.

Citation

Smith, D. (2012), "Arguments about Methods in Criminal Justice Evaluation", Bowen, E. and Brown, S. (Ed.) Perspectives on Evaluating Criminal Justice and Corrections (Advances in Program Evaluation, Vol. 13), Emerald Group Publishing Limited, Leeds, pp. 49-69. https://doi.org/10.1108/S1474-7863(2012)0000013007