Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
By: Zihan Ding , Junlong Chen , Per Ola Kristensson and more
Potential Business Impact:
Lets you edit long videos easily with words.
Creators struggle to edit long-form, narrative-rich videos not because of UI complexity, but due to the cognitive demands of searching, storyboarding, and sequencing hours of footage. Existing transcript- or embedding-based methods fall short for creative workflows, as models struggle to track characters, infer motivations, and connect dispersed events. We present a prompt-driven, modular editing system that helps creators restructure multi-hour content through free-form prompts rather than timelines. At its core is a semantic indexing pipeline that builds a global narrative via temporal segmentation, guided memory compression, and cross-granularity fusion, producing interpretable traces of plot, dialogue, emotion, and context. Users receive cinematic edits while optionally refining transparent intermediate outputs. Evaluated on 400+ videos with expert ratings, QA, and preference studies, our system scales prompt-driven editing, preserves narrative coherence, and balances automation with creator control.
Similar Papers
Text2Story: Advancing Video Storytelling with Text Guidance
CV and Pattern Recognition
Creates long, smooth stories from text.
Prompt2LVideos: Exploring Prompts for Understanding Long-Form Multimodal Videos
CV and Pattern Recognition
Helps computers understand long videos without humans.
Audio-Guided Visual Editing with Complex Multi-Modal Prompts
CV and Pattern Recognition
Lets you edit pictures using sounds and words.