GFix: Perceptually Enhanced Gaussian Splatting Video Compression
By: Siyue Teng , Ge Gao , Duolikun Danier and more
Potential Business Impact:
Makes 3D videos look better and smaller.
3D Gaussian Splatting (3DGS) enhances 3D scene reconstruction through explicit representation and fast rendering, demonstrating potential benefits for various low-level vision tasks, including video compression. However, existing 3DGS-based video codecs generally exhibit more noticeable visual artifacts and relatively low compression ratios. In this paper, we specifically target the perceptual enhancement of 3DGS-based video compression, based on the assumption that artifacts from 3DGS rendering and quantization resemble noisy latents sampled during diffusion training. Building on this premise, we propose a content-adaptive framework, GFix, comprising a streamlined, single-step diffusion model that serves as an off-the-shelf neural enhancer. Moreover, to increase compression efficiency, We propose a modulated LoRA scheme that freezes the low-rank decompositions and modulates the intermediate hidden states, thereby achieving efficient adaptation of the diffusion backbone with highly compressible updates. Experimental results show that GFix delivers strong perceptual quality enhancement, outperforming GSVC with up to 72.1% BD-rate savings in LPIPS and 21.4% in FID.
Similar Papers
RAVE: Rate-Adaptive Visual Encoding for 3D Gaussian Splatting
CV and Pattern Recognition
Shrinks 3D scenes for faster, smaller virtual worlds.
GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors
CV and Pattern Recognition
Fixes blurry 3D pictures from few photos.
Image-Conditioned 3D Gaussian Splat Quantization
CV and Pattern Recognition
Shrinks 3D scenes to tiny files, updates them later.