SELIC: Semantic-Enhanced Learned Image Compression via High-Level Textual Guidance
By: Haisheng Fu , Jie Liang , Zhenman Fang and more
Potential Business Impact:
Makes pictures smaller with better meaning.
Learned image compression (LIC) techniques have achieved remarkable progress; however, effectively integrating high-level semantic information remains challenging. In this work, we present a \underline{S}emantic-\underline{E}nhanced \underline{L}earned \underline{I}mage \underline{C}ompression framework, termed \textbf{SELIC}, which leverages high-level textual guidance to improve rate-distortion performance. Specifically, \textbf{SELIC} employs a text encoder to extract rich semantic descriptions from the input image. These textual features are transformed into fixed-dimension tensors and seamlessly fused with the image-derived latent representation. By embedding the \textbf{SELIC} tensor directly into the compression pipeline, our approach enriches the bitstream without requiring additional inputs at the decoder, thereby maintaining fast and efficient decoding. Extensive experiments on benchmark datasets (e.g., Kodak) demonstrate that integrating semantic information substantially enhances compression quality. Our \textbf{SELIC}-guided method outperforms a baseline LIC model without semantic integration by approximately 0.1-0.15 dB across a wide range of bit rates in PSNR and achieves a 4.9\% BD-rate improvement over VVC. Moreover, this improvement comes with minimal computational overhead, making the proposed \textbf{SELIC} framework a practical solution for advanced image compression applications.
Similar Papers
Extremely low-bitrate Image Compression Semantically Disentangled by LMMs from a Human Perception Perspective
CV and Pattern Recognition
Makes tiny pictures look clear and detailed.
Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion
CV and Pattern Recognition
Makes pictures look good with less data.
SIC: Similarity-Based Interpretable Image Classification with Neural Networks
CV and Pattern Recognition
Shows why computers make decisions, like a detective.