Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360° Scenes
By: Shaoxiang Wang , Shihong Zhang , Christen Millerdurai and more
Potential Business Impact:
Cleans up messy 360 photos by removing objects.
Despite recent advances in single-object front-facing inpainting using NeRF and 3D Gaussian Splatting (3DGS), inpainting in complex 360{\deg} scenes remains largely underexplored. This is primarily due to three key challenges: (i) identifying target objects in the 3D field of 360{\deg} environments, (ii) dealing with severe occlusions in multi-object scenes, which makes it hard to define regions to inpaint, and (iii) maintaining consistent and high-quality appearance across views effectively. To tackle these challenges, we propose Inpaint360GS, a flexible 360{\deg} editing framework based on 3DGS that supports multi-object removal and high-fidelity inpainting in 3D space. By distilling 2D segmentation into 3D and leveraging virtual camera views for contextual guidance, our method enables accurate object-level editing and consistent scene completion. We further introduce a new dataset tailored for 360{\deg} inpainting, addressing the lack of ground truth object-free scenes. Experiments demonstrate that Inpaint360GS outperforms existing baselines and achieves state-of-the-art performance. Project page: https://dfki-av.github.io/inpaint360gs/
Similar Papers
SplatFill: 3D Scene Inpainting via Depth-Guided Gaussian Splatting
CV and Pattern Recognition
Fills in missing parts of 3D scenes perfectly.
Seam360GS: Seamless 360° Gaussian Splatting from Real-World Omnidirectional Images
CV and Pattern Recognition
Fixes blurry 360-degree pictures for VR.
Visibility-Uncertainty-guided 3D Gaussian Inpainting via Scene Conceptional Learning
CV and Pattern Recognition
Fills in missing parts of 3D scenes realistically.