Neel Guha (Stanford University): An Institutional View of Legal AI Benchmarking

Der Vortrag findet auf Englisch statt!

About the Speaker
Neel Guha is a PhD candidate in Computer Science at Stanford University and a graduate of Stanford Law School. His research sits at the intersection of artificial intelligence and law, focusing on how machine learning systems can improve legal practice and expand access to justice, as well as how legal institutions should adapt to the growing use of AI. His work on benchmarking and evaluating AI systems for legal applications has been widely adopted in the legal technology sector, and he has published extensively on topics including AI governance, liability, and regulatory design.

About the Topic
Despite growing enthusiasm for the use of artificial intelligence in legal practice, there remains limited public information about the performance and risks of widely deployed systems. Recent findings have highlighted persistent issues such as “hallucinations,” where models generate inaccurate or fabricated legal information, raising concerns at the highest levels of the judiciary. This contribution argues for the importance of public benchmarking in legal AI. It examines the relative opacity of the legal AI ecosystem, the institutional challenges involved in designing meaningful benchmarks, and the risks of capture or misuse. Rather than proposing a single solution, it explores how different benchmarking approaches must be tailored to varying resource constraints, emphasizing the need for carefully designed institutions to ensure transparency, reliability, and accountability in legal AI.

About the Speaker Series
The Artificial Justice Speaker Series features guests working at the intersection between law, computer science, and the humanities. Neither technical nor juristic knowledge is a prerequisite for participation—the Series is aimed at anyone with an interest in critical and interdisciplinary perspectives on “Law and AI.” The event takes place on Zoom and is scheduled to last one hour.

Der virtuelle Vortrag findet als Videokonferenz über Zoom statt. Bitte melden Sie sich bis spätestens Dienstag, den 12. Mai 2026, mit diesem LINK zum virtuellen Vortrag an.
Die Zugangsdaten erhalten Sie am Dienstagnachmittag. Bitte prüfen Sie auch Ihren Spam-Ordner, falls Sie keine E-Mail mit den Zugangsdaten erhalten.

Bitte bestätigen Sie bei der Anmeldung, dass Sie der Nutzung von Zoom zustimmen und die Veranstaltung nicht aufzeichnen werden. Mit Ihrer Teilnahme an der Veranstaltung bestätigen Sie, dass Sie die Nutzungsbedingungen und die Datenschutzrichtlinie von Zoom gelesen und akzeptiert haben.