Vehicle Dynamics Embedded World Models for Autonomous Driving
By: Huiqian Li , Wei Pan , Haodong Zhang and more
Potential Business Impact:
Helps self-driving cars learn to drive any car.
World models have gained significant attention as a promising approach for autonomous driving. By emulating human-like perception and decision-making processes, these models can predict and adapt to dynamic environments. Existing methods typically map high-dimensional observations into compact latent spaces and learn optimal policies within these latent representations. However, prior work usually jointly learns ego-vehicle dynamics and environmental transition dynamics from the image input, leading to inefficiencies and a lack of robustness to variations in vehicle dynamics. To address these issues, we propose the Vehicle Dynamics embedded Dreamer (VDD) method, which decouples the modeling of ego-vehicle dynamics from environmental transition dynamics. This separation allows the world model to generalize effectively across vehicles with diverse parameters. Additionally, we introduce two strategies to further enhance the robustness of the learned policy: Policy Adjustment during Deployment (PAD) and Policy Augmentation during Training (PAT). Comprehensive experiments in simulated environments demonstrate that the proposed model significantly improves both driving performance and robustness to variations in vehicle dynamics, outperforming existing approaches.
Similar Papers
A Survey of World Models for Autonomous Driving
Robotics
Helps self-driving cars predict and plan driving.
VeMo: A Lightweight Data-Driven Approach to Model Vehicle Dynamics
Robotics
Teaches cars to predict their own movements.
World Models for Autonomous Navigation of Terrestrial Robots from LIDAR Observations
Robotics
Helps robots learn to drive better using less data.