With artificial intelligence (AI) becoming widespread in all sectors, police are looking to adopt AI tools. However, they need to be able to determine which of these tools are the most effective. Jacob Verrey, a PhD candidate at the Institute of Criminology, has published an article arguing a snake oil filter can achieve this.
Originating in medical science, the snake oil filter is a system designed to test the effectiveness of medical products. Verrey discusses how this methodology can translate into studying the effectiveness of AI tools. Snake oil filters consist of three stages. The first stage is a validation study, which tests the tool's basic effectiveness in a controlled setting. This is followed by an impact assessment, which applies it to real-world use by the police. Finally, the tools are subject to monitored deployment by the entire police force.
Verrey discusses the potential research methods for every stage, and the cautions with each one. However, he is confident that a snake oil filter can ensure AI tools are an effective component of modern policing.
The article, 'The snake oil filter: A deployment pipeline police can use to separate ineffective AI tools from those that work', is available to view on Policing Insight.