Gaussian Blending: Rethinking Alpha Blending in 3D Gaussian Splatting
By: Junseo Koo, Jinseo Jeong, Gunhee Kim
Potential Business Impact:
Makes 3D pictures look clearer from any angle.
The recent introduction of 3D Gaussian Splatting (3DGS) has significantly advanced novel view synthesis. Several studies have further improved the rendering quality of 3DGS, yet they still exhibit noticeable visual discrepancies when synthesizing views at sampling rates unseen during training. Specifically, they suffer from (i) erosion-induced blurring artifacts when zooming in and (ii) dilation-induced staircase artifacts when zooming out. We speculate that these artifacts arise from the fundamental limitation of the alpha blending adopted in 3DGS methods. Instead of the conventional alpha blending that computes alpha and transmittance as scalar quantities over a pixel, we propose to replace it with our novel Gaussian Blending that treats alpha and transmittance as spatially varying distributions. Thus, transmittances can be updated considering the spatial distribution of alpha values across the pixel area, allowing nearby background splats to contribute to the final rendering. Our Gaussian Blending maintains real-time rendering speed and requires no additional memory cost, while being easily integrated as a drop-in replacement into existing 3DGS-based or other NVS frameworks. Extensive experiments demonstrate that Gaussian Blending effectively captures fine details at various sampling rates unseen during training, consistently outperforming existing novel view synthesis models across both unseen and seen sampling rates.
Similar Papers
Moment-Based 3D Gaussian Splatting: Resolving Volumetric Occlusion with Order-Independent Transmittance
CV and Pattern Recognition
Renders see-through objects perfectly, no matter how they overlap.
IBGS: Image-Based Gaussian Splatting
CV and Pattern Recognition
Makes 3D pictures look more real and detailed.
RobustSplat++: Decoupling Densification, Dynamics, and Illumination for In-the-Wild 3DGS
CV and Pattern Recognition
Makes 3D pictures ignore moving things and changing light.