ARC-Chapter: Structuring Hour-Long Videos into Navigable Chapters and Hierarchical Summaries
By: Junfu Pu , Teng Wang , Yixiao Ge and more
Potential Business Impact:
Breaks long videos into easy-to-find chapters.
The proliferation of hour-long videos (e.g., lectures, podcasts, documentaries) has intensified demand for efficient content structuring. However, existing approaches are constrained by small-scale training with annotations that are typical short and coarse, restricting generalization to nuanced transitions in long videos. We introduce ARC-Chapter, the first large-scale video chaptering model trained on over million-level long video chapters, featuring bilingual, temporally grounded, and hierarchical chapter annotations. To achieve this goal, we curated a bilingual English-Chinese chapter dataset via a structured pipeline that unifies ASR transcripts, scene texts, visual captions into multi-level annotations, from short title to long summaries. We demonstrate clear performance improvements with data scaling, both in data volume and label intensity. Moreover, we design a new evaluation metric termed GRACE, which incorporates many-to-one segment overlaps and semantic similarity, better reflecting real-world chaptering flexibility. Extensive experiments demonstrate that ARC-Chapter establishes a new state-of-the-art by a significant margin, outperforming the previous best by 14.0% in F1 score and 11.3% in SODA score. Moreover, ARC-Chapter shows excellent transferability, improving the state-of-the-art on downstream tasks like dense video captioning on YouCook2.
Similar Papers
ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shorts
CV and Pattern Recognition
Helps computers understand short videos like people do.
HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compression
CV and Pattern Recognition
Makes online shopping videos tell better stories.
Chapter-Llama: Efficient Chaptering in Hour-Long Videos with LLMs
CV and Pattern Recognition
Divides long videos into chapters with titles.