GACL: Grounded Adaptive Curriculum Learning with Active Task and Performance Monitoring
By: Linji Wang , Zifan Xu , Peter Stone and more
Potential Business Impact:
Teaches robots new skills faster and better.
Plain English Summary
Robots can now learn to do tricky jobs much faster and better, even in difficult situations. This is because a new system helps them practice in a smart order, starting with easier steps and gradually moving to harder ones, just like how we learn. This means robots could soon be more reliable at tasks like helping in warehouses or exploring dangerous places.
Curriculum learning has emerged as a promising approach for training complex robotics tasks, yet current applications predominantly rely on manually designed curricula, which demand significant engineering effort and can suffer from subjective and suboptimal human design choices. While automated curriculum learning has shown success in simple domains like grid worlds and games where task distributions can be easily specified, robotics tasks present unique challenges: they require handling complex task spaces while maintaining relevance to target domain distributions that are only partially known through limited samples. To this end, we propose Grounded Adaptive Curriculum Learning, a framework specifically designed for robotics curriculum learning with three key innovations: (1) a task representation that consistently handles complex robot task design, (2) an active performance tracking mechanism that allows adaptive curriculum generation appropriate for the robot's current capabilities, and (3) a grounding approach that maintains target domain relevance through alternating sampling between reference and synthetic tasks. We validate GACL on wheeled navigation in constrained environments and quadruped locomotion in challenging 3D confined spaces, achieving 6.8% and 6.1% higher success rates, respectively, than state-of-the-art methods in each domain.
Similar Papers
Scaling Rough Terrain Locomotion with Automatic Curriculum Reinforcement Learning
Robotics
Robot learns to walk anywhere, fast.
Knowledge capture, adaptation and composition (KCAC): A framework for cross-task curriculum learning in robotic manipulation
Robotics
Teaches robots to learn tasks faster and better.
Automatic Curriculum Learning for Driving Scenarios: Towards Robust and Efficient Reinforcement Learning
Robotics
Teaches self-driving cars to learn better.