BSGS: Bi-stage 3D Gaussian Splatting for Camera Motion Deblurring
By: An Zhao , Piaopiao Yu , Zhe Zhu and more
Potential Business Impact:
Cleans up blurry 3D pictures to show clear scenes.
3D Gaussian Splatting has exhibited remarkable capabilities in 3D scene reconstruction.However, reconstructing high-quality 3D scenes from motion-blurred images caused by camera motion poses a significant challenge.The performance of existing 3DGS-based deblurring methods are limited due to their inherent mechanisms, such as extreme dependence on the accuracy of camera poses and inability to effectively control erroneous Gaussian primitives densification caused by motion blur.To solve these problems, we introduce a novel framework, Bi-Stage 3D Gaussian Splatting, to accurately reconstruct 3D scenes from motion-blurred images.BSGS contains two stages. First, Camera Pose Refinement roughly optimizes camera poses to reduce motion-induced distortions. Second, with fixed rough camera poses, Global RigidTransformation further corrects motion-induced blur distortions.To alleviate multi-subframe gradient conflicts, we propose a subframe gradient aggregation strategy to optimize both stages.Furthermore, a space-time bi-stage optimization strategy is introduced to dynamically adjust primitive densification thresholds and prevent premature noisy Gaussian generation in blurred regions. Comprehensive experiments verify the effectiveness of our proposed deblurring method and show its superiority over the state of the arts.
Similar Papers
GeMS: Efficient Gaussian Splatting for Extreme Motion Blur
CV and Pattern Recognition
Cleans up blurry pictures to make 3D scenes.
Splatography: Sparse multi-view dynamic Gaussian Splatting for filmmaking challenges
CV and Pattern Recognition
Makes 3D movies from fewer camera shots.
Camera Pose Refinement via 3D Gaussian Splatting
CV and Pattern Recognition
Makes 3D pictures more accurate without retraining.