EPIC v. DOJ (Criminal Justice Algorithms)

Top News

Background

"Evidence-based assessment tools," or "risk assessments," are algorithms that "try to predict recidivism -- repeat offending or breaking the rules of probation or parole -- using statistical probabilities based on factors such as age, employment history and prior criminal record." Today, federal and state officials across the country use evidence-based risk assessment tools to make decisions at all stages of criminal justice process. These techniques are controversial: the reliability, fairness, and constitutional legitimacy of "evidence-based" tools are rigorously contested.

Nonetheless, risk assessments are increasingly used to make sentencing and other significant decisions in the criminal justice system. With many tools the product of private enterprise, risk assessment has become a competitive industry. Transparency of these techniques is of the utmost importance and is necessary to secure fair outcomes, preserve the rights of individuals, and maintain accountability across the criminal justice system.

Commercial risk assessment tools are already in use in criminal cases across the country. The Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) and the Level of Service Inventory Revised (LSI-R) purport to assess individuals' risk levels and criminogenic needs based on a wide range of personal factors. COMPAS, for example, considers factors such as social isolation, criminal associations, and criminal personality, while LSI-R uses factors including leisure, accommodations, and attitudes or orientation. The federal Post-Conviction Risk Assessment (PCRA) likewise uses information such as criminal history, education, employment, and social networks to reach a "final conclusion regarding risk level and criminogenic needs."

The DOJ has said that it aims "to build a systemwide framework (arrest through final disposition and discharge)" of evidence-based decision-making. Yet even the DOJ has expressed reservations about the use of criminal justice algorithms. The department's Criminal Division called assessments based on sociological and personal information rather than prior bad acts "dangerous" and constitutionally suspect, citing the disparate impacts of risk assessments and the erosion of consistent sentencing. Former U.S. Attorney General Eric Holder has said that "basing sentencing decisions on static factors and immutable characteristics . . . may exacerbate unwarranted and unjust disparities that are already far too common in our criminal justice system and in our society."

The U.S. Supreme Court may also weigh in soon on whether the use of a sentencing algorithm can violate a defendant's constitutional right to due process.

EPIC's Interest

EPIC's Open Government project seeks to ensure that the public is fully informed about the activities of government. The public cannot assess the fairness and reliability of the criminal justice algorithms used by the DOJ without access to relevant departmental records. EPIC therefore has a significant interest in obtaining DOJ documents concerning "evidence-based" practices in sentencing—including policies, guidelines, source codes, and validation studies.

EPIC has also promoted Algorithmic Transparency for many years and has litigated several related FOIA cases:

In 2016, EPIC obtained extensive records from Missouri and Wisconsin concerning both states' use of criminal justice algorithms.

Legal Documents

U.S. District Court for the District of Columbia

Resources

News

Share this page:

Support EPIC

EPIC relies on support from individual donors to pursue our work.

Defend Privacy. Support EPIC.

#Privacy

EPIC Bookstore

Robot Law

Robot Law
by Ryan Calo, A. Michael Froomkin,
Ian Kerr