InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation
By: Jinlai Liu , Jian Han , Bin Yan and more
Potential Business Impact:
Creates realistic videos from text, faster than before.
We introduce InfinityStar, a unified spacetime autoregressive framework for high-resolution image and dynamic video synthesis. Building on the recent success of autoregressive modeling in both vision and language, our purely discrete approach jointly captures spatial and temporal dependencies within a single architecture. This unified design naturally supports a variety of generation tasks such as text-to-image, text-to-video, image-to-video, and long interactive video synthesis via straightforward temporal autoregression. Extensive experiments demonstrate that InfinityStar scores 83.74 on VBench, outperforming all autoregressive models by large margins, even surpassing some diffusion competitors like HunyuanVideo. Without extra optimizations, our model generates a 5s, 720p video approximately 10x faster than leading diffusion-based methods. To our knowledge, InfinityStar is the first discrete autoregressive video generator capable of producing industrial level 720p videos. We release all code and models to foster further research in efficient, high-quality video generation.
Similar Papers
VideoMAR: Autoregressive Video Generatio with Continuous Tokens
CV and Pattern Recognition
Makes videos from pictures, faster and better.
STARFlow-V: End-to-End Video Generative Modeling with Normalizing Flows
CV and Pattern Recognition
Makes computers create realistic videos from text.
Spanning Tree Autoregressive Visual Generation
CV and Pattern Recognition
Lets computers create and edit pictures better.