Legal Zero-Days: A Novel Risk Vector for Advanced AI Systems
By: Greg Sadler, Nathan Sherburn
Potential Business Impact:
Finds hidden legal flaws that can harm AI.
We introduce the concept of "Legal Zero-Days" as a novel risk vector for advanced AI systems. Legal Zero-Days are previously undiscovered vulnerabilities in legal frameworks that, when exploited, can cause immediate and significant societal disruption without requiring litigation or other processes before impact. We present a risk model for identifying and evaluating these vulnerabilities, demonstrating their potential to bypass safeguards or impede government responses to AI incidents. Using the 2017 Australian dual citizenship crisis as a case study, we illustrate how seemingly minor legal oversights can lead to large-scale governance disruption. We develop a methodology for creating "legal puzzles" as evaluation instruments for assessing AI systems' capabilities to discover such vulnerabilities. Our findings suggest that while current AI models may not reliably find impactful Legal Zero-Days, future systems may develop this capability, presenting both risks and opportunities for improving legal robustness. This work contributes to the broader effort to identify and mitigate previously unrecognized risks from frontier AI systems.
Similar Papers
An empirical analysis of zero-day vulnerabilities disclosed by the zero day initiative
Cryptography and Security
Finds hidden computer flaws before hackers do.
Algorithmic A-Legality: Shorting the Human Future through AI
Computers and Society
AI's power outruns laws, causing new problems.
The Verification-Value Paradox: A Normative Critique of Gen AI in Legal Practice
Artificial Intelligence
AI makes lawyers check work more, saving little time.