Next-Scale Prediction: A Self-Supervised Approach for Real-World Image Denoising
By: Yiwen Shan , Haiyu Zhao , Peng Hu and more
Self-supervised real-world image denoising remains a fundamental challenge, arising from the antagonistic trade-off between decorrelating spatially structured noise and preserving high-frequency details. Existing blind-spot network (BSN) methods rely on pixel-shuffle downsampling (PD) to decorrelate noise, but aggressive downsampling fragments fine structures, while milder downsampling fails to remove correlated noise. To address this, we introduce Next-Scale Prediction (NSP), a novel self-supervised paradigm that decouples noise decorrelation from detail preservation. NSP constructs cross-scale training pairs, where BSN takes low-resolution, fully decorrelated sub-images as input to predict high-resolution targets that retain fine details. As a by-product, NSP naturally supports super-resolution of noisy images without retraining or modification. Extensive experiments demonstrate that NSP achieves state-of-the-art self-supervised denoising performance on real-world benchmarks, significantly alleviating the long-standing conflict between noise decorrelation and detail preservation.
Similar Papers
Blind-Spot Guided Diffusion for Self-supervised Real-World Denoising
CV and Pattern Recognition
Cleans up blurry photos without needing good examples.
TTSnap: Test-Time Scaling of Diffusion Models via Noise-Aware Pruning
CV and Pattern Recognition
Finds best AI art faster by skipping bad tries.
Real Noise Decoupling for Hyperspectral Image Denoising
CV and Pattern Recognition
Cleans up blurry pictures from special cameras.