ARMFlow: AutoRegressive MeanFlow for Online 3D Human Reaction Generation
By: Zichen Geng , Zeeshan Hayder , Wei Liu and more
3D human reaction generation faces three main challenges:(1) high motion fidelity, (2) real-time inference, and (3) autoregressive adaptability for online scenarios. Existing methods fail to meet all three simultaneously. We propose ARMFlow, a MeanFlow-based autoregressive framework that models temporal dependencies between actor and reactor motions. It consists of a causal context encoder and an MLP-based velocity predictor. We introduce Bootstrap Contextual Encoding (BSCE) in training, encoding generated history instead of the ground-truth ones, to alleviate error accumulation in autoregressive generation. We further introduce the offline variant ReMFlow, achieving state-of-the-art performance with the fastest inference among offline methods. Our ARMFlow addresses key limitations of online settings by: (1) enhancing semantic alignment via a global contextual encoder; (2) achieving high accuracy and low latency in a single-step inference; and (3) reducing accumulated errors through BSCE. Our single-step online generation surpasses existing online methods on InterHuman and InterX by over 40% in FID, while matching offline state-of-the-art performance despite using only partial sequence conditions.
Similar Papers
JoyAvatar: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion
CV and Pattern Recognition
Makes talking cartoon characters move and talk.
Flowception: Temporally Expansive Flow Matching for Video Generation
CV and Pattern Recognition
Makes videos by adding and fixing pictures.
ARFlow: Human Action-Reaction Flow Matching with Physical Guidance
CV and Pattern Recognition
Makes robots move without bumping into things.