Score: 0

Temporal Triplane Transformers as Occupancy World Models

Published: March 10, 2025 | arXiv ID: 2503.07338v2

By: Haoran Xu , Peixi Peng , Guang Tan and more

Potential Business Impact:

Helps self-driving cars predict the future faster.

Business Areas:
Autonomous Vehicles Transportation

World models aim to learn or construct representations of the environment that enable the prediction of future scenes, thereby supporting intelligent motion planning. However, existing models often struggle to produce fine-grained predictions and to operate in real time. In this work, we propose T$^3$Former, a novel 4D occupancy world model for autonomous driving. T$^3$Former begins by pre-training a compact {\em triplane} representation that efficiently encodes 3D occupancy. It then extracts multi-scale temporal motion features from historical triplanes and employs an autoregressive approach to iteratively predict future triplane changes. Finally, these triplane changes are combined with previous states to decode future occupancy and ego-motion trajectories. Experimental results show that T$^3$Former achieves 1.44$\times$ speedup (26 FPS), improves mean IoU to 36.09, and reduces mean absolute planning error to 1.0 meters. Demos are available in the supplementary material.

Page Count
13 pages

Category
Computer Science:
Robotics