Long-Term Human Motion Prediction Using Spatio-Temporal Maps of Dynamics
By: Yufei Zhu , Andrey Rudenko , Tomasz P. Kucner and more
Potential Business Impact:
Helps robots predict where people will move next.
Long-term human motion prediction (LHMP) is important for the safe and efficient operation of autonomous robots and vehicles in environments shared with humans. Accurate predictions are important for applications including motion planning, tracking, human-robot interaction, and safety monitoring. In this paper, we exploit Maps of Dynamics (MoDs), which encode spatial or spatio-temporal motion patterns as environment features, to achieve LHMP for horizons of up to 60 seconds. We propose an MoD-informed LHMP framework that supports various types of MoDs and includes a ranking method to output the most likely predicted trajectory, improving practical utility in robotics. Further, a time-conditioned MoD is introduced to capture motion patterns that vary across different times of day. We evaluate MoD-LHMP instantiated with three types of MoDs. Experiments on two real-world datasets show that MoD-informed method outperforms learning-based ones, with up to 50\% improvement in average displacement error, and the time-conditioned variant achieves the highest accuracy overall. Project code is available at https://github.com/test-bai-cpu/LHMP-with-MoDs.git
Similar Papers
Human Motion Prediction via Test-domain-aware Adaptation with Easily-available Human Motions Estimated from Videos
CV and Pattern Recognition
Teaches computers to predict human movement better.
Enhancing Context-Aware Human Motion Prediction for Efficient Robot Handovers
Robotics
Robots predict your moves to help you better.
HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA
CV and Pattern Recognition
Teaches computers to understand and create human movement.