MVGSR: Multi-View Consistent 3D Gaussian Super-Resolution via Epipolar Guidance
By: Kaizhe Zhang , Shinan Chen , Qian Zhao and more
Potential Business Impact:
Makes blurry 3D pictures sharp and clear.
Scenes reconstructed by 3D Gaussian Splatting (3DGS) trained on low-resolution (LR) images are unsuitable for high-resolution (HR) rendering. Consequently, a 3DGS super-resolution (SR) method is needed to bridge LR inputs and HR rendering. Early 3DGS SR methods rely on single-image SR networks, which lack cross-view consistency and fail to fuse complementary information across views. More recent video-based SR approaches attempt to address this limitation but require strictly sequential frames, limiting their applicability to unstructured multi-view datasets. In this work, we introduce Multi-View Consistent 3D Gaussian Splatting Super-Resolution (MVGSR), a framework that focuses on integrating multi-view information for 3DGS rendering with high-frequency details and enhanced consistency. We first propose an Auxiliary View Selection Method based on camera poses, making our method adaptable for arbitrarily organized multi-view datasets without the need of temporal continuity or data reordering. Furthermore, we introduce, for the first time, an epipolar-constrained multi-view attention mechanism into 3DGS SR, which serves as the core of our proposed multi-view SR network. This design enables the model to selectively aggregate consistent information from auxiliary views, enhancing the geometric consistency and detail fidelity of 3DGS representations. Extensive experiments demonstrate that our method achieves state-of-the-art performance on both object-centric and scene-level 3DGS SR benchmarks.
Similar Papers
SplatSuRe: Selective Super-Resolution for Multi-view Consistent 3D Gaussian Splatting
CV and Pattern Recognition
Makes 3D pictures look sharper and clearer.
MVGSR: Multi-View Consistency Gaussian Splatting for Robust Surface Reconstruction
CV and Pattern Recognition
Makes 3D models from moving pictures accurately.
IE-SRGS: An Internal-External Knowledge Fusion Framework for High-Fidelity 3D Gaussian Splatting Super-Resolution
CV and Pattern Recognition
Makes blurry 3D pictures sharp and clear.