Towards Data-Driven Metrics for Social Robot Navigation Benchmarking
By: Pilar Bachiller-Burgos , Ulysses Bernardet , Luis V. Calderita and more
Potential Business Impact:
Helps robots learn to walk around people safely.
This paper presents a joint effort towards the development of a data-driven Social Robot Navigation metric to facilitate benchmarking and policy optimization. We provide our motivations for our approach and describe our proposal for storing rated social navigation trajectory datasets. Following these guidelines, we compiled a dataset with 4427 trajectories -- 182 real and 4245 simulated -- and presented it to human raters, yielding a total of 4402 rated trajectories after data quality assurance. We also trained an RNN-based baseline metric on the dataset and present quantitative and qualitative results. All data, software, and model weights are publicly available.
Similar Papers
A short methodological review on social robot navigation benchmarking
Robotics
Helps robots safely walk around people.
A New Trajectory-Oriented Approach to Enhancing Comprehensive Crowd Navigation Performance
Robotics
Makes robots walk smoother and more naturally.
Metrics vs Surveys: Can Quantitative Measures Replace Human Surveys in Social Robot Navigation? A Correlation Analysis
Robotics
Robot paths get better by watching people.