Nav-$R^2$ Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigation
By: Wentao Xiang , Haokang Zhang , Tianhang Yang and more
Potential Business Impact:
Helps robots find new things in new places.
Object-goal navigation in open-vocabulary settings requires agents to locate novel objects in unseen environments, yet existing approaches suffer from opaque decision-making processes and low success rate on locating unseen objects. To address these challenges, we propose Nav-$R^2$, a framework that explicitly models two critical types of relationships, target-environment modeling and environment-action planning, through structured Chain-of-Thought (CoT) reasoning coupled with a Similarity-Aware Memory. We construct a Nav$R^2$-CoT dataset that teaches the model to perceive the environment, focus on target-related objects in the surrounding context and finally make future action plans. Our SA-Mem preserves the most target-relevant and current observation-relevant features from both temporal and semantic perspectives by compressing video frames and fusing historical observations, while introducing no additional parameters. Compared to previous methods, Nav-R^2 achieves state-of-the-art performance in localizing unseen objects through a streamlined and efficient pipeline, avoiding overfitting to seen object categories while maintaining real-time inference at 2Hz. Resources will be made publicly available at \href{https://github.com/AMAP-EAI/Nav-R2}{github link}.
Similar Papers
RSRNav: Reasoning Spatial Relationship for Image-Goal Navigation
CV and Pattern Recognition
Helps robots find things by understanding where they are.
Nav-R1: Reasoning and Navigation in Embodied Scenes
Robotics
Helps robots explore new places by thinking ahead.
What Matters in RL-Based Methods for Object-Goal Navigation? An Empirical Study and A Unified Framework
Robotics
Robots find objects in new places better.