Monocular Online Reconstruction with Enhanced Detail Preservation
By: Songyin Wu , Zhaoyang Lv , Yufeng Zhu and more
Potential Business Impact:
Makes 3D pictures from one camera view.
We propose an online 3D Gaussian-based dense mapping framework for photorealistic details reconstruction from a monocular image stream. Our approach addresses two key challenges in monocular online reconstruction: distributing Gaussians without relying on depth maps and ensuring both local and global consistency in the reconstructed maps. To achieve this, we introduce two key modules: the Hierarchical Gaussian Management Module for effective Gaussian distribution and the Global Consistency Optimization Module for maintaining alignment and coherence at all scales. In addition, we present the Multi-level Occupancy Hash Voxels (MOHV), a structure that regularizes Gaussians for capturing details across multiple levels of granularity. MOHV ensures accurate reconstruction of both fine and coarse geometries and textures, preserving intricate details while maintaining overall structural integrity. Compared to state-of-the-art RGB-only and even RGB-D methods, our framework achieves superior reconstruction quality with high computational efficiency. Moreover, it integrates seamlessly with various tracking systems, ensuring generality and scalability.
Similar Papers
ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos
CV and Pattern Recognition
Makes 3D movies from one video, instantly.
On-the-fly Large-scale 3D Reconstruction from Multi-Camera Rigs
CV and Pattern Recognition
Builds 3D worlds from many cameras fast.
SplatMAP: Online Dense Monocular SLAM with 3D Gaussian Splatting
CV and Pattern Recognition
Makes 3D models from videos more real.