SemGeoMo: Dynamic Contextual Human Motion Generation with Semantic and Geometric Guidance
By: Peishan Cong , Ziyi Wang , Yuexin Ma and more
Potential Business Impact:
Creates realistic human movements for robots.
Generating reasonable and high-quality human interactive motions in a given dynamic environment is crucial for understanding, modeling, transferring, and applying human behaviors to both virtual and physical robots. In this paper, we introduce an effective method, SemGeoMo, for dynamic contextual human motion generation, which fully leverages the text-affordance-joint multi-level semantic and geometric guidance in the generation process, improving the semantic rationality and geometric correctness of generative motions. Our method achieves state-of-the-art performance on three datasets and demonstrates superior generalization capability for diverse interaction scenarios. The project page and code can be found at https://4dvlab.github.io/project_page/semgeomo/.
Similar Papers
SegMo: Segment-aligned Text to 3D Human Motion Generation
CV and Pattern Recognition
Makes characters move like you describe.
A Self-supervised Motion Representation for Portrait Video Generation
CV and Pattern Recognition
Makes videos move realistically from just sound.
GENMO: A GENeralist Model for Human MOtion
Graphics
Makes one computer program create and fix body movements.