Leveraging Learned Image Prior for 3D Gaussian Compression
By: Seungjoo Shin, Jaesik Park, Sunghyun Cho
Potential Business Impact:
Makes 3D pictures smaller without losing detail.
Compression techniques for 3D Gaussian Splatting (3DGS) have recently achieved considerable success in minimizing storage overhead for 3D Gaussians while preserving high rendering quality. Despite the impressive storage reduction, the lack of learned priors restricts further advances in the rate-distortion trade-off for 3DGS compression tasks. To address this, we introduce a novel 3DGS compression framework that leverages the powerful representational capacity of learned image priors to recover compression-induced quality degradation. Built upon initially compressed Gaussians, our restoration network effectively models the compression artifacts in the image space between degraded and original Gaussians. To enhance the rate-distortion performance, we provide coarse rendering residuals into the restoration network as side information. By leveraging the supervision of restored images, the compressed Gaussians are refined, resulting in a highly compact representation with enhanced rendering performance. Our framework is designed to be compatible with existing Gaussian compression methods, making it broadly applicable across different baselines. Extensive experiments validate the effectiveness of our framework, demonstrating superior rate-distortion performance and outperforming the rendering quality of state-of-the-art 3DGS compression methods while requiring substantially less storage.
Similar Papers
GFix: Perceptually Enhanced Gaussian Splatting Video Compression
CV and Pattern Recognition
Makes 3D videos look better and smaller.
Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modeling
CV and Pattern Recognition
Shrinks 3D scenes to fit on phones.
Image-Conditioned 3D Gaussian Splat Quantization
CV and Pattern Recognition
Shrinks 3D scenes to tiny files, updates them later.