Score: 2

Evolution without an Oracle: Driving Effective Evolution with LLM Judges

Published: November 23, 2025 | arXiv ID: 2511.19489v1

By: Zhe Zhao , Yuheng Yang , Haibin Wen and more

BigTech Affiliations: Princeton University Stanford University

Potential Business Impact:

Lets computers learn from opinions, not just facts.

Business Areas:
Machine Learning Artificial Intelligence, Data and Analytics, Software

The integration of Large Language Models (LLMs) with Evolutionary Computation (EC) has unlocked new frontiers in scientific discovery but remains shackled by a fundamental constraint: the reliance on an Oracle--an objective, machine-computable fitness function. This paper breaks this barrier by asking: Can evolution thrive in a purely subjective landscape governed solely by LLM judges? We introduce MADE (Multi-Agent Decomposed Evolution), a framework that tames the inherent noise of subjective evaluation through "Problem Specification." By decomposing vague instructions into specific, verifiable sub-requirements, MADE transforms high-variance LLM feedback into stable, precise selection pressure. The results are transformative: across complex benchmarks like DevAI and InfoBench, MADE outperforms strong baselines by over 50% in software requirement satisfaction (39.9% to 61.9%) and achieves a 95% perfect pass rate on complex instruction following. This work validates a fundamental paradigm shift: moving from optimizing "computable metrics" to "describable qualities," thereby unlocking evolutionary optimization for the vast open-ended domains where no ground truth exists.

Country of Origin
🇺🇸 United States

Page Count
14 pages

Category
Computer Science:
Software Engineering