Deblur Gaussian Splatting SLAM
By: Francesco Girlanda , Denys Rozumnyi , Marc Pollefeys and more
Potential Business Impact:
Cleans up blurry photos from moving cameras.
We present Deblur-SLAM, a robust RGB SLAM pipeline designed to recover sharp reconstructions from motion-blurred inputs. The proposed method bridges the strengths of both frame-to-frame and frame-to-model approaches to model sub-frame camera trajectories that lead to high-fidelity reconstructions in motion-blurred settings. Moreover, our pipeline incorporates techniques such as online loop closure and global bundle adjustment to achieve a dense and precise global trajectory. We model the physical image formation process of motion-blurred images and minimize the error between the observed blurry images and rendered blurry images obtained by averaging sharp virtual sub-frame images. Additionally, by utilizing a monocular depth estimator alongside the online deformation of Gaussians, we ensure precise mapping and enhanced image deblurring. The proposed SLAM pipeline integrates all these components to improve the results. We achieve state-of-the-art results for sharp map estimation and sub-frame trajectory recovery both on synthetic and real-world blurry input data.
Similar Papers
DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurring
CV and Pattern Recognition
Makes blurry pictures clear for 3D scenes.
ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videos
CV and Pattern Recognition
Builds 3D worlds from videos in real-time.
UPGS: Unified Pose-aware Gaussian Splatting for Dynamic Scene Deblurring
CV and Pattern Recognition
Fixes blurry videos for better 3D worlds.