Estimating Control Barriers from Offline Data
By: Hongzhan Yu , Seth Farrell , Ryo Yoshimitsu and more
Potential Business Impact:
Robots learn to avoid danger with less data.
Learning-based methods for constructing control barrier functions (CBFs) are gaining popularity for ensuring safe robot control. A major limitation of existing methods is their reliance on extensive sampling over the state space or online system interaction in simulation. In this work we propose a novel framework for learning neural CBFs through a fixed, sparsely-labeled dataset collected prior to training. Our approach introduces new annotation techniques based on out-of-distribution analysis, enabling efficient knowledge propagation from the limited labeled data to the unlabeled data. We also eliminate the dependency on a high-performance expert controller, and allow multiple sub-optimal policies or even manual control during data collection. We evaluate the proposed method on real-world platforms. With limited amount of offline data, it achieves state-of-the-art performance for dynamic obstacle avoidance, demonstrating statistically safer and less conservative maneuvers compared to existing methods.
Similar Papers
Learning Conservative Neural Control Barrier Functions from Offline Data
Machine Learning (CS)
Keeps robots safe by learning from past mistakes.
Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation
Artificial Intelligence
Keeps robots from crashing into things.
Learning Safety for Obstacle Avoidance via Control Barrier Functions
Robotics
Helps robots avoid bumping into things.