Score: 0

CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation

Published: December 27, 2025 | arXiv ID: 2512.22536v1

By: Qinglin Zeng , Kaitong Cai , Ruiqi Chen and more

Potential Business Impact:

Makes videos stay the same person and place.

Business Areas:
Motion Capture Media and Entertainment, Video

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and unstable temporal structure. We propose CoAgent, a collaborative and closed-loop framework for coherent video generation that formulates the process as a plan-synthesize-verify pipeline. Given a user prompt, style reference, and pacing constraints, a Storyboard Planner decomposes the input into structured shot-level plans with explicit entities, spatial relations, and temporal cues. A Global Context Manager maintains entity-level memory to preserve appearance and identity consistency across shots. Each shot is then generated by a Synthesis Module under the guidance of a Visual Consistency Controller, while a Verifier Agent evaluates intermediate results using vision-language reasoning and triggers selective regeneration when inconsistencies are detected. Finally, a pacing-aware editor refines temporal rhythm and transitions to match the desired narrative flow. Extensive experiments demonstrate that CoAgent significantly improves coherence, visual consistency, and narrative quality in long-form video generation.

Page Count
15 pages

Category
Computer Science:
CV and Pattern Recognition