A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI
By: Lik Hang Kenny Wong , Xueyang Kang , Kaixin Bai and more
Potential Business Impact:
Makes robots learn real-world tasks from computer games.
Navigation and manipulation are core capabilities in Embodied AI, yet training agents with these capabilities in the real world faces high costs and time complexity. Therefore, sim-to-real transfer has emerged as a key approach, yet the sim-to-real gap persists. This survey examines how physics simulators address this gap by analyzing their properties overlooked in previous surveys. We also analyze their features for navigation and manipulation tasks, along with hardware requirements. Additionally, we offer a resource with benchmark datasets, metrics, simulation platforms, and cutting-edge methods-such as world models and geometric equivariance-to help researchers select suitable tools while accounting for hardware constraints.
Similar Papers
A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
Robotics
Teaches robots to learn and act in the real world.
Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspective
Robotics
Helps robots learn in games, then work in real life.
Towards a Unified Understanding of Robot Manipulation: A Comprehensive Survey
Robotics
Helps robots learn to pick up and move things.