IQPFR: An Image Quality Prior for Blind Face Restoration and Beyond
By: Peng Hu , Chunming He , Lei Xu and more
Potential Business Impact:
Makes blurry faces clear and sharp again.
Blind Face Restoration (BFR) addresses the challenge of reconstructing degraded low-quality (LQ) facial images into high-quality (HQ) outputs. Conventional approaches predominantly rely on learning feature representations from ground-truth (GT) data; however, inherent imperfections in GT datasets constrain restoration performance to the mean quality level of the training data, rather than attaining maximally attainable visual quality. To overcome this limitation, we propose a novel framework that incorporates an Image Quality Prior (IQP) derived from No-Reference Image Quality Assessment (NR-IQA) models to guide the restoration process toward optimal HQ reconstructions. Our methodology synergizes this IQP with a learned codebook prior through two critical innovations: (1) During codebook learning, we devise a dual-branch codebook architecture that disentangles feature extraction into universal structural components and HQ-specific attributes, ensuring comprehensive representation of both common and high-quality facial characteristics. (2) In the codebook lookup stage, we implement a quality-conditioned Transformer-based framework. NR-IQA-derived quality scores act as dynamic conditioning signals to steer restoration toward the highest feasible quality standard. This score-conditioned paradigm enables plug-and-play enhancement of existing BFR architectures without modifying the original structure. We also formulate a discrete representation-based quality optimization strategy that circumvents over-optimization artifacts prevalent in continuous latent space approaches. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques across multiple benchmarks. Besides, our quality-conditioned framework demonstrates consistent performance improvements when integrated with prior BFR models. The code will be released.
Similar Papers
Unlocking the Potential of Diffusion Priors in Blind Face Restoration
CV and Pattern Recognition
Fixes blurry faces in pictures.
Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumption
CV and Pattern Recognition
Makes pictures look better, even if original is bad.
Fine-grained Image Quality Assessment for Perceptual Image Restoration
Image and Video Processing
Rates how well pictures are fixed.