Zero-Reference Joint Low-Light Enhancement and Deblurring via Visual Autoregressive Modeling with VLM-Derived Modulation
By: Wei Dong , Han Zhou , Junwei Lin and more
Potential Business Impact:
Cleans up dark, blurry, noisy pictures automatically.
Real-world dark images commonly exhibit not only low visibility and contrast but also complex noise and blur, posing significant restoration challenges. Existing methods often rely on paired data or fail to model dynamic illumination and blur characteristics, leading to poor generalization. To tackle this, we propose a generative framework based on visual autoregressive (VAR) modeling, guided by perceptual priors from the vision-language model (VLM). Specifically, to supply informative conditioning cues for VAR models, we deploy an adaptive curve estimation scheme to modulate the diverse illumination based on VLM-derived visibility scores. In addition, we integrate dynamic and spatial-frequency-aware Rotary Positional Encodings (SF-RoPE) into VAR to enhance its ability to model structures degraded by blur. Furthermore, we propose a recursive phase-domain modulation strategy that mitigates blur-induced artifacts in the phase domain via bounded iterative refinement guided by VLM-assessed blur scores. Our framework is fully unsupervised and achieves state-of-the-art performance on benchmark datasets.
Similar Papers
VLM-Augmented Degradation Modeling for Image Restoration Under Adverse Weather Conditions
CV and Pattern Recognition
Clears blurry pictures from rain, fog, and snow.
Autoregressive Semantic Visual Reconstruction Helps VLMs Understand Better
CV and Pattern Recognition
Teaches computers to understand pictures better.
Visual Autoregressive Modeling for Instruction-Guided Image Editing
CV and Pattern Recognition
Edits pictures perfectly, following your exact words.