TextInPlace: Indoor Visual Place Recognition in Repetitive Structures with Scene Text Spotting and Verification
By: Huaqi Tao , Bingxi Liu , Calvin Chen and more
Potential Business Impact:
Helps robots remember indoor places using signs.
Visual Place Recognition (VPR) is a crucial capability for long-term autonomous robots, enabling them to identify previously visited locations using visual information. However, existing methods remain limited in indoor settings due to the highly repetitive structures inherent in such environments. We observe that scene texts frequently appear in indoor spaces and can help distinguish visually similar but different places. This inspires us to propose TextInPlace, a simple yet effective VPR framework that integrates Scene Text Spotting (STS) to mitigate visual perceptual ambiguity in repetitive indoor environments. Specifically, TextInPlace adopts a dual-branch architecture within a local parameter sharing network. The VPR branch employs attention-based aggregation to extract global descriptors for coarse-grained retrieval, while the STS branch utilizes a bridging text spotter to detect and recognize scene texts. Finally, the discriminative texts are filtered to compute text similarity and re-rank the top-K retrieved images. To bridge the gap between current text-based repetitive indoor scene datasets and the typical scenarios encountered in robot navigation, we establish an indoor VPR benchmark dataset, called Maze-with-Text. Extensive experiments on both custom and public datasets demonstrate that TextInPlace achieves superior performance over existing methods that rely solely on appearance information. The dataset, code, and trained models are publicly available at https://github.com/HqiTao/TextInPlace.
Similar Papers
TeTRA-VPR: A Ternary Transformer Approach for Compact Visual Place Recognition
CV and Pattern Recognition
Makes robots see and remember places better, faster.
Multi-Platform Teach-and-Repeat Navigation by Visual Place Recognition Based on Deep-Learned Local Features
Robotics
Helps robots find their way anywhere, day or night.
Semantic-Enhanced Cross-Modal Place Recognition for Robust Robot Localization
CV and Pattern Recognition
Helps robots find their way without GPS.