Methodological Quality and Validity Issues in the Crime Prevention Literature

This paper presents an assessment of the existing literature on validity and methodology relevant to crime prevention studies. Reports eligible for inclusion in the review focused on assessing the methodological quality of crime prevention evaluations. A narrative synthesis approach was used to review the included reports to examine how validity considerations are assessed and addressed in criminological impact evaluations. The reports reviewed included substantive discussions of the five types of validity, as well as discussions of interrelated issues of evaluation design, methodological quality scales, and evidence-based registries. We recommend that all crime prevention evaluations address the methodological issues discussed in this article. In addition, policymakers should consume research with a critical eye toward potential validity issues. Where valid evaluations show interventions to be promising, practitioners should make efforts to ensure fidelity in program implementation. Registries should support policymakers and practitioners in identifying and implementing evidence-based policy and programming through providing guidance on choosing interventions aligned to their priorities and settings, understanding the strengths and weaknesses of various strategies and programs and the conditions under which they are successful, and implementing programs and replicating evaluations with fidelity.