DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurring
By: Pengteng Li , Yunfan Lu , Pinhao Song and more
Potential Business Impact:
Makes blurry pictures clear for 3D scenes.
In this paper, we propose the first Structure-from-Motion (SfM)-free deblurring 3D Gaussian Splatting method via event camera, dubbed DeblurSplat. We address the motion-deblurring problem in two ways. First, we leverage the pretrained capability of the dense stereo module (DUSt3R) to directly obtain accurate initial point clouds from blurred images. Without calculating camera poses as an intermediate result, we avoid the cumulative errors transfer from inaccurate camera poses to the initial point clouds' positions. Second, we introduce the event stream into the deblur pipeline for its high sensitivity to dynamic change. By decoding the latent sharp images from the event stream and blurred images, we can provide a fine-grained supervision signal for scene reconstruction optimization. Extensive experiments across a range of scenes demonstrate that DeblurSplat not only excels in generating high-fidelity novel views but also achieves significant rendering efficiency compared to the SOTAs in deblur 3D-GS.
Similar Papers
Deblur Gaussian Splatting SLAM
CV and Pattern Recognition
Cleans up blurry photos from moving cameras.
Event-guided 3D Gaussian Splatting for Dynamic Human and Scene Reconstruction
CV and Pattern Recognition
Makes blurry videos show moving people clearly.
EBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting
CV and Pattern Recognition
Fixes blurry pictures to make 3D scenes clear.