Score: 3

MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restoration

Published: March 12, 2025 | arXiv ID: 2503.09131v2

By: Zhehui Wu , Yong Chen , Naoto Yokoya and more

Potential Business Impact:

Cleans up blurry pictures using words and images.

Business Areas:
Visual Search Internet Services

Hyperspectral images (HSIs) often suffer from diverse and unknown degradations during imaging, leading to severe spectral and spatial distortions. Existing HSI restoration methods typically rely on specific degradation assumptions, limiting their effectiveness in complex scenarios. In this paper, we propose \textbf{MP-HSIR}, a novel multi-prompt framework that effectively integrates spectral, textual, and visual prompts to achieve universal HSI restoration across diverse degradation types and intensities. Specifically, we develop a prompt-guided spatial-spectral transformer, which incorporates spatial self-attention and a prompt-guided dual-branch spectral self-attention. Since degradations affect spectral features differently, we introduce spectral prompts in the local spectral branch to provide universal low-rank spectral patterns as prior knowledge for enhancing spectral reconstruction. Furthermore, the text-visual synergistic prompt fuses high-level semantic representations with fine-grained visual features to encode degradation information, thereby guiding the restoration process. Extensive experiments on 9 HSI restoration tasks, including all-in-one scenarios, generalization tests, and real-world cases, demonstrate that MP-HSIR not only consistently outperforms existing all-in-one methods but also surpasses state-of-the-art task-specific approaches across multiple tasks. The code and models are available at https://github.com/ZhehuiWu/MP-HSIR.

Country of Origin
🇯🇵 🇨🇳 China, Japan

Repos / Data Links

Page Count
21 pages

Category
Computer Science:
CV and Pattern Recognition