Score: 2

DexFlow: A Unified Approach for Dexterous Hand Pose Retargeting and Interaction

Published: May 2, 2025 | arXiv ID: 2505.01083v1

By: Xiaoyi Lin , Kunpeng Yao , Lixin Xu and more

BigTech Affiliations: Massachusetts Institute of Technology

Potential Business Impact:

Makes robot hands grab things more like people.

Business Areas:
Motion Capture Media and Entertainment, Video

Despite advances in hand-object interaction modeling, generating realistic dexterous manipulation data for robotic hands remains a challenge. Retargeting methods often suffer from low accuracy and fail to account for hand-object interactions, leading to artifacts like interpenetration. Generative methods, lacking human hand priors, produce limited and unnatural poses. We propose a data transformation pipeline that combines human hand and object data from multiple sources for high-precision retargeting. Our approach uses a differential loss constraint to ensure temporal consistency and generates contact maps to refine hand-object interactions. Experiments show our method significantly improves pose accuracy, naturalness, and diversity, providing a robust solution for hand-object interaction modeling.

Country of Origin
πŸ‡ΊπŸ‡Έ πŸ‡¨πŸ‡³ United States, China

Page Count
7 pages

Category
Computer Science:
Robotics