SeeLe: A Unified Acceleration Framework for Real-Time Gaussian Splatting
By: Xiaotong Huang , He Zhu , Zihan Liu and more
Potential Business Impact:
Makes 3D graphics run fast on phones.
3D Gaussian Splatting (3DGS) has become a crucial rendering technique for many real-time applications. However, the limited hardware resources on today's mobile platforms hinder these applications, as they struggle to achieve real-time performance. In this paper, we propose SeeLe, a general framework designed to accelerate the 3DGS pipeline for resource-constrained mobile devices. Specifically, we propose two GPU-oriented techniques: hybrid preprocessing and contribution-aware rasterization. Hybrid preprocessing alleviates the GPU compute and memory pressure by reducing the number of irrelevant Gaussians during rendering. The key is to combine our view-dependent scene representation with online filtering. Meanwhile, contribution-aware rasterization improves the GPU utilization at the rasterization stage by prioritizing Gaussians with high contributions while reducing computations for those with low contributions. Both techniques can be seamlessly integrated into existing 3DGS pipelines with minimal fine-tuning. Collectively, our framework achieves 2.6$\times$ speedup and 32.3\% model reduction while achieving superior rendering quality compared to existing methods.
Similar Papers
GauRast: Enhancing GPU Triangle Rasterizers to Accelerate 3D Gaussian Splatting
Graphics
Makes 3D pictures faster on phones.
GCC: A 3DGS Inference Architecture with Gaussian-Wise and Cross-Stage Conditional Processing
Hardware Architecture
Makes 3D pictures load faster and use less power.
Accelerating 3D Gaussian Splatting with Neural Sorting and Axis-Oriented Rasterization
Graphics
Makes virtual worlds look real on phones.