Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
By: Mingyang Yu, Zhijian Wu, Dingjiang Huang
Potential Business Impact:
Improves pictures by adding back lost details.
Hyperspectral image (HSI) reconstruction aims to recover 3D HSI from its degraded 2D measurements. Recently great progress has been made in deep learning-based methods, however, these methods often struggle to accurately capture high-frequency details of the HSI. To address this issue, this paper proposes a Spectral Diffusion Prior (SDP) that is implicitly learned from hyperspectral images using a diffusion model. Leveraging the powerful ability of the diffusion model to reconstruct details, this learned prior can significantly improve the performance when injected into the HSI model. To further improve the effectiveness of the learned prior, we also propose the Spectral Prior Injector Module (SPIM) to dynamically guide the model to recover the HSI details. We evaluate our method on two representative HSI methods: MST and BISRNet. Experimental results show that our method outperforms existing networks by about 0.5 dB, effectively improving the performance of HSI reconstruction.
Similar Papers
Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements
CV and Pattern Recognition
Makes blurry pictures of light colors sharp again.
Hyperspectral Image Generation with Unmixing Guided Diffusion Model
CV and Pattern Recognition
Makes fake pictures that look like real, colorful light.
SpectralAdapt: Semi-Supervised Domain Adaptation with Spectral Priors for Human-Centered Hyperspectral Image Reconstruction
CV and Pattern Recognition
Lets doctors see hidden details in body scans.