PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction
By: Mingzhi Pei , Xu Cao , Xiangyi Wang and more
Potential Business Impact:
Makes 3D models of shiny things accurately.
Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.
Similar Papers
Multi-view Surface Reconstruction Using Normal and Reflectance Cues
CV and Pattern Recognition
Makes 3D models from pictures more detailed.
Neural Multi-View Self-Calibrated Photometric Stereo without Photometric Stereo Cues
CV and Pattern Recognition
Makes 3D objects look real from photos.
Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild
CV and Pattern Recognition
Makes 3D models from messy photos.