Metrics vs Surveys: Can Quantitative Measures Replace Human Surveys in Social Robot Navigation? A Correlation Analysis
By: Stefano Trepella , Mauro Martini , Noé Pérez-Higueras and more
Potential Business Impact:
Robot paths get better by watching people.
Social, also called human-aware, navigation is a key challenge for the integration of mobile robots into human environments. The evaluation of such systems is complex, as factors such as comfort, safety, and legibility must be considered. Human-centered assessments, typically conducted through surveys, provide reliable insights but are costly, resource-intensive, and difficult to reproduce or compare across systems. Alternatively, numerical social navigation metrics are easy to compute and facilitate comparisons, yet the community lacks consensus on a standard set of metrics. This work explores the relationship between numerical metrics and human-centered evaluations to identify potential correlations. If specific quantitative measures align with human perceptions, they could serve as standardized evaluation tools, reducing the dependency on surveys. Our results indicate that while current metrics capture some aspects of robot navigation behavior, important subjective factors remain insufficiently represented and new metrics are necessary.
Similar Papers
A short methodological review on social robot navigation benchmarking
Robotics
Helps robots safely walk around people.
Assessing Human Cooperation for Enhancing Social Robot Navigation
Robotics
Robots learn to talk to people better.
Towards Data-Driven Metrics for Social Robot Navigation Benchmarking
Robotics
Helps robots learn to walk around people safely.