Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth
By: Jinyoung Jun , Lei Chu , Jiahao Li and more
Potential Business Impact:
Makes 3D pictures clearer and more accurate.
We propose a novel two-stage framework for sensor depth enhancement, called Perfecting Depth. This framework leverages the stochastic nature of diffusion models to automatically detect unreliable depth regions while preserving geometric cues. In the first stage (stochastic estimation), the method identifies unreliable measurements and infers geometric structure by leveraging a training-inference domain gap. In the second stage (deterministic refinement), it enforces structural consistency and pixel-level accuracy using the uncertainty map derived from the first stage. By combining stochastic uncertainty modeling with deterministic refinement, our method yields dense, artifact-free depth maps with improved reliability. Experimental results demonstrate its effectiveness across diverse real-world scenarios. Furthermore, theoretical analysis, various experiments, and qualitative visualizations validate its robustness and scalability. Our framework sets a new baseline for sensor depth enhancement, with potential applications in autonomous driving, robotics, and immersive technologies.
Similar Papers
Real-World Depth Recovery via Structure Uncertainty Modeling and Inaccurate GT Depth Fitting
CV and Pattern Recognition
Fixes blurry depth pictures for better 3D understanding.
Towards Sharper Object Boundaries in Self-Supervised Depth Estimation
CV and Pattern Recognition
Makes 3D pictures clearer at edges.
UM-Depth : Uncertainty Masked Self-Supervised Monocular Depth Estimation with Visual Odometry
CV and Pattern Recognition
Makes self-driving cars see better in tricky spots.