Collaborative Multi-Robot Non-Prehensile Manipulation via Flow-Matching Co-Generation
By: Yorai Shaoul , Zhe Chen , Mohamed Naveed Gul Mohamed and more
Potential Business Impact:
Robots work together to move many things in messy places.
Coordinating a team of robots to reposition multiple objects in cluttered environments requires reasoning jointly about where robots should establish contact, how to manipulate objects once contact is made, and how to navigate safely and efficiently at scale. Prior approaches typically fall into two extremes -- either learning the entire task or relying on privileged information and hand-designed planners -- both of which struggle to handle diverse objects in long-horizon tasks. To address these challenges, we present a unified framework for collaborative multi-robot, multi-object non-prehensile manipulation that integrates flow-matching co-generation with anonymous multi-robot motion planning. Within this framework, a generative model co-generates contact formations and manipulation trajectories from visual observations, while a novel motion planner conveys robots at scale. Crucially, the same planner also supports coordination at the object level, assigning manipulated objects to larger target structures and thereby unifying robot- and object-level reasoning within a single algorithmic framework. Experiments in challenging simulated environments demonstrate that our approach outperforms baselines in both motion planning and manipulation tasks, highlighting the benefits of generative co-design and integrated planning for scaling collaborative manipulation to complex multi-agent, multi-object settings. Visit gco-paper.github.io for code and demonstrations.
Similar Papers
CollaBot: Vision-Language Guided Simultaneous Collaborative Manipulation
Robotics
Robots work together to move big things.
Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Control
CV and Pattern Recognition
Robots learn to move objects together better.
PushingBots: Collaborative Pushing via Neural Accelerated Combinatorial Hybrid Optimization
Robotics
Robots push big things together to move them.