Enhancing Physical Consistency in Lightweight World Models
By: Dingrui Wang , Zhexiao Sun , Zhouheng Li and more
Potential Business Impact:
Helps self-driving cars predict better, faster.
A major challenge in deploying world models is the trade-off between size and performance. Large world models can capture rich physical dynamics but require massive computing resources, making them impractical for edge devices. Small world models are easier to deploy but often struggle to learn accurate physics, leading to poor predictions. We propose the Physics-Informed BEV World Model (PIWM), a compact model designed to efficiently capture physical interactions in bird's-eye-view (BEV) representations. PIWM uses Soft Mask during training to improve dynamic object modeling and future prediction. We also introduce a simple yet effective technique, Warm Start, for inference to enhance prediction quality with a zero-shot model. Experiments show that at the same parameter scale (400M), PIWM surpasses the baseline by 60.6% in weighted overall score. Moreover, even when compared with the largest baseline model (400M), the smallest PIWM (130M Soft Mask) achieves a 7.4% higher weighted overall score with a 28% faster inference speed.
Similar Papers
Learning Primitive Embodied World Models: Towards Scalable Robotic Learning
Robotics
Robots learn to do many tasks from less practice.
Learning Primitive Embodied World Models: Towards Scalable Robotic Learning
Robotics
Robots learn to do tasks with less practice.
Dream to Drive with Predictive Individual World Model
Robotics
Helps self-driving cars predict other cars' moves.