HERE: Hierarchical Active Exploration of Radiance Field with Epistemic Uncertainty Minimization
By: Taekbeom Lee , Dabin Kim , Youngseok Jang and more
We present HERE, an active 3D scene reconstruction framework based on neural radiance fields, enabling high-fidelity implicit mapping. Our approach centers around an active learning strategy for camera trajectory generation, driven by accurate identification of unseen regions, which supports efficient data acquisition and precise scene reconstruction. The key to our approach is epistemic uncertainty quantification based on evidential deep learning, which directly captures data insufficiency and exhibits a strong correlation with reconstruction errors. This allows our framework to more reliably identify unexplored or poorly reconstructed regions compared to existing methods, leading to more informed and targeted exploration. Additionally, we design a hierarchical exploration strategy that leverages learned epistemic uncertainty, where local planning extracts target viewpoints from high-uncertainty voxels based on visibility for trajectory generation, and global planning uses uncertainty to guide large-scale coverage for efficient and comprehensive reconstruction. The effectiveness of the proposed method in active 3D reconstruction is demonstrated by achieving higher reconstruction completeness compared to previous approaches on photorealistic simulated scenes across varying scales, while a hardware demonstration further validates its real-world applicability.
Similar Papers
Active3D: Active High-Fidelity 3D Reconstruction via Hierarchical Uncertainty Quantification
Robotics
Builds 3D models of things faster and better.
SiLVR: Scalable Lidar-Visual Radiance Field Reconstruction with Uncertainty Quantification
Robotics
Makes 3D pictures from cameras and lasers.
Joint Learning of Depth, Pose, and Local Radiance Field for Large Scale Monocular 3D Reconstruction
CV and Pattern Recognition
Creates 3D worlds from one camera.