GaRe: Relightable 3D Gaussian Splatting for Outdoor Scenes from Unconstrained Photo Collections
By: Haiyang Bai , Jiaqi Zhu , Songru Jiang and more
Potential Business Impact:
Makes 3D scenes look real with changing light.
We propose a 3D Gaussian splatting-based framework for outdoor relighting that leverages intrinsic image decomposition to precisely integrate sunlight, sky radiance, and indirect lighting from unconstrained photo collections. Unlike prior methods that compress the per-image global illumination into a single latent vector, our approach enables simultaneously diverse shading manipulation and the generation of dynamic shadow effects. This is achieved through three key innovations: (1) a residual-based sun visibility extraction method to accurately separate direct sunlight effects, (2) a region-based supervision framework with a structural consistency loss for physically interpretable and coherent illumination decomposition, and (3) a ray-tracing-based technique for realistic shadow simulation. Extensive experiments demonstrate that our framework synthesizes novel views with competitive fidelity against state-of-the-art relighting solutions and produces more natural and multifaceted illumination and shadow effects.
Similar Papers
ROSGS: Relightable Outdoor Scenes With Gaussian Splatting
CV and Pattern Recognition
Makes outdoor scenes look real with new lighting.
RelightAnyone: A Generalized Relightable 3D Gaussian Head Model
CV and Pattern Recognition
Makes 3D avatars look real in any light.
SplatBright: Generalizable Low-Light Scene Reconstruction from Sparse Views via Physically-Guided Gaussian Enhancement
CV and Pattern Recognition
Makes dark photos clear for 3D pictures.