From Physical Degradation Models to Task-Aware All-in-One Image Restoration
By: Hu Gao , Xiaoning Lei , Xichen Xu and more
All-in-one image restoration aims to adaptively handle multiple restoration tasks with a single trained model. Although existing methods achieve promising results by introducing prompt information or leveraging large models, the added learning modules increase system complexity and hinder real-time applicability. In this paper, we adopt a physical degradation modeling perspective and predict a task-aware inverse degradation operator for efficient all-in-one image restoration. The framework consists of two stages. In the first stage, the predicted inverse operator produces an initial restored image together with an uncertainty perception map that highlights regions difficult to reconstruct, ensuring restoration reliability. In the second stage, the restoration is further refined under the guidance of this uncertainty map. The same inverse operator prediction network is used in both stages, with task-aware parameters introduced after operator prediction to adapt to different degradation tasks. Moreover, by accelerating the convolution of the inverse operator, the proposed method achieves efficient all-in-one image restoration. The resulting tightly integrated architecture, termed OPIR, is extensively validated through experiments, demonstrating superior all-in-one restoration performance while remaining highly competitive on task-aligned restoration.
Similar Papers
ClusIR: Towards Cluster-Guided All-in-One Image Restoration
CV and Pattern Recognition
Fixes blurry pictures with different problems.
TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal
CV and Pattern Recognition
Cleans blurry pictures from bad weather.
Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution
CV and Pattern Recognition
Fixes blurry pictures with many problems.