Hierarchical Learning-Enhanced MPC for Safe Crowd Navigation with Heterogeneous Constraints
By: Huajian Liu , Yixuan Feng , Wei Dong and more
Potential Business Impact:
Robots navigate tricky, changing places better.
In this paper, we propose a novel hierarchical framework for robot navigation in dynamic environments with heterogeneous constraints. Our approach leverages a graph neural network trained via reinforcement learning (RL) to efficiently estimate the robot's cost-to-go, formulated as local goal recommendations. A spatio-temporal path-searching module, which accounts for kinematic constraints, is then employed to generate a reference trajectory to facilitate solving the non-convex optimization problem used for explicit constraint enforcement. More importantly, we introduce an incremental action-masking mechanism and a privileged learning strategy, enabling end-to-end training of the proposed planner. Both simulation and real-world experiments demonstrate that the proposed method effectively addresses local planning in complex dynamic environments, achieving state-of-the-art (SOTA) performance. Compared with existing learning-optimization hybrid methods, our approach eliminates the dependency on high-fidelity simulation environments, offering significant advantages in computational efficiency and training scalability. The code will be released as open-source upon acceptance of the paper.
Similar Papers
Hierarchical Reinforcement Learning with Low-Level MPC for Multi-Agent Control
Systems and Control
Helps robots learn to move safely together.
Socially Aware Robot Crowd Navigation via Online Uncertainty-Driven Risk Adaptation
Robotics
Robots learn to walk safely through crowds.
An MPC framework for efficient navigation of mobile robots in cluttered environments
Robotics
Robot finds paths and avoids crashing fast.