MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning
By: Shuyuan Lin , Mengtin Lo , Haosheng Chen and more
Potential Business Impact:
Helps computers see matching objects in different pictures.
Two-view correspondence learning is a key task in computer vision, which aims to establish reliable matching relationships for applications such as camera pose estimation and 3D reconstruction. However, existing methods have limitations in local geometric modeling and cross-stage information optimization, which make it difficult to accurately capture the geometric constraints of matched pairs and thus reduce the robustness of the model. To address these challenges, we propose a Multi-Graph Contextual Attention Network (MGCA-Net), which consists of a Contextual Geometric Attention (CGA) module and a Cross-Stage Multi-Graph Consensus (CSMGC) module. Specifically, CGA dynamically integrates spatial position and feature information via an adaptive attention mechanism and enhances the capability to capture both local and global geometric relationships. Meanwhile, CSMGC establishes geometric consensus via a cross-stage sparse graph network, ensuring the consistency of geometric information across different stages. Experimental results on two representative YFCC100M and SUN3D datasets show that MGCA-Net significantly outperforms existing SOTA methods in the outlier rejection and camera pose estimation tasks. Source code is available at http://www.linshuyuan.com.
Similar Papers
Context-Aware Network Based on Multi-scale Spatio-temporal Attention for Action Recognition in Videos
CV and Pattern Recognition
Helps computers understand what's happening in videos.
SC-Net: Robust Correspondence Learning via Spatial and Cross-Channel Context
CV and Pattern Recognition
Finds matching points in pictures better.
Improving Cross-view Object Geo-localization: A Dual Attention Approach with Cross-view Interaction and Multi-Scale Spatial Features
CV and Pattern Recognition
Helps find objects using pictures from different angles.