PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherence
By: Ruiyan Wang , Teng Hu , Kaihui Huang and more
Potential Business Impact:
Makes any character move like you want.
Pose-guided video generation refers to controlling the motion of subjects in generated video through a sequence of poses. It enables precise control over subject motion and has important applications in animation. However, current pose-guided video generation methods are limited to accepting only human poses as input, thus generalizing poorly to pose of other subjects. To address this issue, we propose PoseAnything, the first universal pose-guided video generation framework capable of handling both human and non-human characters, supporting arbitrary skeletal inputs. To enhance consistency preservation during motion, we introduce Part-aware Temporal Coherence Module, which divides the subject into different parts, establishes part correspondences, and computes cross-attention between corresponding parts across frames to achieve fine-grained part-level consistency. Additionally, we propose Subject and Camera Motion Decoupled CFG, a novel guidance strategy that, for the first time, enables independent camera movement control in pose-guided video generation, by separately injecting subject and camera motion control information into the positive and negative anchors of CFG. Furthermore, we present XPose, a high-quality public dataset containing 50,000 non-human pose-video pairs, along with an automated pipeline for annotation and filtering. Extensive experiments demonstrate that Pose-Anything significantly outperforms state-of-the-art methods in both effectiveness and generalization.
Similar Papers
MoCapAnything: Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos
CV and Pattern Recognition
Lets any object in a video move like a character.
PersonaAnimator: Personalized Motion Transfer from Unconstrained Videos
CV and Pattern Recognition
Makes characters move like real people in videos.
Synthetic Human Action Video Data Generation with Pose Transfer
CV and Pattern Recognition
Makes fake videos of people move realistically.