From Volume Rendering to 3D Gaussian Splatting: Theory and Applications
By: Vitor Pereira Matias , Daniel Perazzo , Vinicius Silva and more
Potential Business Impact:
Creates realistic 3D worlds from photos fast.
The problem of 3D reconstruction from posed images is undergoing a fundamental transformation, driven by continuous advances in 3D Gaussian Splatting (3DGS). By modeling scenes explicitly as collections of 3D Gaussians, 3DGS enables efficient rasterization through volumetric splatting, offering thus a seamless integration with common graphics pipelines. Despite its real-time rendering capabilities for novel view synthesis, 3DGS suffers from a high memory footprint, the tendency to bake lighting effects directly into its representation, and limited support for secondary-ray effects. This tutorial provides a concise yet comprehensive overview of the 3DGS pipeline, starting from its splatting formulation and then exploring the main efforts in addressing its limitations. Finally, we survey a range of applications that leverage 3DGS for surface reconstruction, avatar modeling, animation, and content generation-highlighting its efficient rendering and suitability for feed-forward pipelines.
Similar Papers
The Impact and Outlook of 3D Gaussian Splatting
CV and Pattern Recognition
Creates realistic 3D worlds from photos instantly.
Adaptive 3D Gaussian Splatting Video Streaming
CV and Pattern Recognition
Makes 3D videos stream smoothly, even with bad internet.
Does 3D Gaussian Splatting Need Accurate Volumetric Rendering?
Graphics
Makes 3D scenes look real, faster than before.