Deep Active Inference with Diffusion Policy and Multiple Timescale World Model for Real-World Exploration and Navigation
By: Riko Yokozawa , Kentaro Fujii , Yuta Nomura and more
Potential Business Impact:
Robots learn to explore and reach goals.
Autonomous robotic navigation in real-world environments requires exploration to acquire environmental information as well as goal-directed navigation in order to reach specified targets. Active inference (AIF) based on the free-energy principle provides a unified framework for these behaviors by minimizing the expected free energy (EFE), thereby combining epistemic and extrinsic values. To realize this practically, we propose a deep AIF framework that integrates a diffusion policy as the policy model and a multiple timescale recurrent state-space model (MTRSSM) as the world model. The diffusion policy generates diverse candidate actions while the MTRSSM predicts their long-horizon consequences through latent imagination, enabling action selection that minimizes EFE. Real-world navigation experiments demonstrated that our framework achieved higher success rates and fewer collisions compared with the baselines, particularly in exploration-demanding scenarios. These results highlight how AIF based on EFE minimization can unify exploration and goal-directed navigation in real-world robotic settings.
Similar Papers
Real-World Robot Control by Deep Active Inference With a Temporally Hierarchical World Model
Robotics
Robots learn to explore and act smartly.
Bio-Inspired Topological Autonomous Navigation with Active Inference in Robotics
Robotics
Robots explore new places without needing maps.
Navigation and Exploration with Active Inference: from Biology to Industry
Robotics
Robot learns to explore new places by itself.