AGORA: Incentivizing Group Emergence Capability in LLMs via Group Distillation
By: Ren Zhuang, Ben Wang, Shuifa Sun
Potential Business Impact:
Computers learn to solve harder math problems together.
Progress in complex reasoning is constrained by the static nature of the current training datasets. We propose structured interaction as a new scaling axis, moving beyond the prevailing paradigm of increasing model parameters. Our self-evolving framework, AGORA, enables a collaborative ensemble to achieve reasoning performance exceeding state-of-the-art monolithic systems by up to 4.45 percentage points on challenging mathematical benchmarks. This gain stems from group emergent ability-the synthesis of collective capabilities unattainable by isolated models, validating interaction as a scalable driver of intelligence. Our results position the engineering of collaborative ecosystems as a vital frontier for capability emergence.
Similar Papers
Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
Computation and Language
Makes AI assistants smarter and easier to build.
Emergent Coordination in Multi-Agent Language Models
Multiagent Systems
Makes AI teams work together better.
Reasoning-Aware Prompt Orchestration: A Foundation Model for Multi-Agent Language Model Coordination
Multiagent Systems
Makes AI teams work together better and faster.