Leveraging Cycle-Consistent Anchor Points for Self-Supervised RGB-D Registration
By: Siddharth Tourani , Jayaram Reddy , Sarvesh Thakur and more
Potential Business Impact:
Helps computers understand 3D spaces from pictures.
With the rise in consumer depth cameras, a wealth of unlabeled RGB-D data has become available. This prompts the question of how to utilize this data for geometric reasoning of scenes. While many RGB-D registration meth- ods rely on geometric and feature-based similarity, we take a different approach. We use cycle-consistent keypoints as salient points to enforce spatial coherence constraints during matching, improving correspondence accuracy. Additionally, we introduce a novel pose block that combines a GRU recurrent unit with transformation synchronization, blending historical and multi-view data. Our approach surpasses previous self- supervised registration methods on ScanNet and 3DMatch, even outperforming some older supervised methods. We also integrate our components into existing methods, showing their effectiveness.
Similar Papers
ViGG: Robust RGB-D Point Cloud Registration using Visual-Geometric Mutual Guidance
CV and Pattern Recognition
Makes 3D scans match perfectly, even with messy data.
Generative Point Cloud Registration
CV and Pattern Recognition
Helps 3D scans match up better.
Registration is a Powerful Rotation-Invariance Learner for 3D Anomaly Detection
CV and Pattern Recognition
Finds tiny flaws in 3D shapes, even when tilted.