Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation
By: Luca Marzari , Francesco Trotti , Enrico Marchesini and more
Potential Business Impact:
Keeps robots from crashing into things.
Achieving safe autonomous navigation systems is critical for deploying robots in dynamic and uncertain real-world environments. In this paper, we propose a hierarchical control framework leveraging neural network verification techniques to design control barrier functions (CBFs) and policy correction mechanisms that ensure safe reinforcement learning navigation policies. Our approach relies on probabilistic enumeration to identify unsafe regions of operation, which are then used to construct a safe CBF-based control layer applicable to arbitrary policies. We validate our framework both in simulation and on a real robot, using a standard mobile robot benchmark and a highly dynamic aquatic environmental monitoring task. These experiments demonstrate the ability of the proposed solution to correct unsafe actions while preserving efficient navigation behavior. Our results show the promise of developing hierarchical verification-based systems to enable safe and robust navigation behaviors in complex scenarios.
Similar Papers
Certificated Actor-Critic: Hierarchical Reinforcement Learning with Control Barrier Functions for Safe Navigation
Robotics
Keeps robots safe while they learn.
Neural Control Barrier Functions from Physics Informed Neural Networks
Robotics
Makes robots safer by learning rules from physics.
CP-NCBF: A Conformal Prediction-based Approach to Synthesize Verified Neural Control Barrier Functions
Systems and Control
Makes robots safer by checking their actions.