PrediFlow: A Flow-Based Prediction-Refinement Framework for Real-Time Human Motion Prediction in Human-Robot Collaboration
By: Sibo Tian, Minghui Zheng, Xiao Liang
Potential Business Impact:
Helps robots predict human movements for safer teamwork.
Stochastic human motion prediction is critical for safe and effective human-robot collaboration (HRC) in industrial remanufacturing, as it captures human motion uncertainties and multi-modal behaviors that deterministic methods cannot handle. While earlier works emphasize highly diverse predictions, they often generate unrealistic human motions. More recent methods focus on accuracy and real-time performance, yet there remains potential to improve prediction quality further without exceeding time budgets. Additionally, current research on stochastic human motion prediction in HRC typically considers human motion in isolation, neglecting the influence of robot motion on human behavior. To address these research gaps and enable real-time, realistic, and interaction-aware human motion prediction, we propose a novel prediction-refinement framework that integrates both human and robot observed motion to refine the initial predictions produced by a pretrained state-of-the-art predictor. The refinement module employs a Flow Matching structure to account for uncertainty. Experimental studies on the HRC desktop disassembly dataset demonstrate that our method significantly improves prediction accuracy while preserving the uncertainties and multi-modalities of human motion. Moreover, the total inference time of the proposed framework remains within the time budget, highlighting the effectiveness and practicality of our approach.
Similar Papers
Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesis
CV and Pattern Recognition
Makes robots move and react like real people.
Adaptive Motion Planning via Contact-Based Intent Inference for Human-Robot Collaboration
Robotics
Robots learn to move with people by feeling them.
HumanCM: One Step Human Motion Prediction
CV and Pattern Recognition
Makes computer-animated people move more realistically.