CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation
By: Qinglin Zeng , Kaitong Cai , Ruiqi Chen and more
Potential Business Impact:
Makes videos stay the same person and place.
Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and unstable temporal structure. We propose CoAgent, a collaborative and closed-loop framework for coherent video generation that formulates the process as a plan-synthesize-verify pipeline. Given a user prompt, style reference, and pacing constraints, a Storyboard Planner decomposes the input into structured shot-level plans with explicit entities, spatial relations, and temporal cues. A Global Context Manager maintains entity-level memory to preserve appearance and identity consistency across shots. Each shot is then generated by a Synthesis Module under the guidance of a Visual Consistency Controller, while a Verifier Agent evaluates intermediate results using vision-language reasoning and triggers selective regeneration when inconsistencies are detected. Finally, a pacing-aware editor refines temporal rhythm and transitions to match the desired narrative flow. Extensive experiments demonstrate that CoAgent significantly improves coherence, visual consistency, and narrative quality in long-form video generation.
Similar Papers
Visual-Aware CoT: Achieving High-Fidelity Visual Consistency in Unified Models
CV and Pattern Recognition
Keeps pictures looking right when making new ones.
VisAgent: Narrative-Preserving Story Visualization Framework
CV and Pattern Recognition
Turns stories into clear, meaningful pictures.
Automated Movie Generation via Multi-Agent CoT Planning
CV and Pattern Recognition
Makes movies automatically from a script.