RoboBenchMart: Benchmarking Robots in Retail Environment
By: Konstantin Soshin , Alexander Krapukhin , Andrei Spiridonov and more
Potential Business Impact:
Helps robots pick groceries in messy stores.
Most existing robotic manipulation benchmarks focus on simplified tabletop scenarios, typically involving a stationary robotic arm interacting with various objects on a flat surface. To address this limitation, we introduce RoboBenchMart, a more challenging and realistic benchmark designed for dark store environments, where robots must perform complex manipulation tasks with diverse grocery items. This setting presents significant challenges, including dense object clutter and varied spatial configurations -- with items positioned at different heights, depths, and in close proximity. By targeting the retail domain, our benchmark addresses a setting with strong potential for near-term automation impact. We demonstrate that current state-of-the-art generalist models struggle to solve even common retail tasks. To support further research, we release the RoboBenchMart suite, which includes a procedural store layout generator, a trajectory generation pipeline, evaluation tools and fine-tuned baseline models.
Similar Papers
ResponsibleRobotBench: Benchmarking Responsible Robot Manipulation using Multi-modal Large Language Models
Robotics
Teaches robots to avoid dangerous mistakes.
From Pixels to Shelf: End-to-End Algorithmic Control of a Mobile Manipulator for Supermarket Stocking and Fronting
Robotics
Robot stocks shelves faster than humans.
Bench-Push: Benchmarking Pushing-based Navigation and Manipulation Tasks for Mobile Robots
Robotics
Tests robots that push things to move.