Clustering-Guided Spatial-Spectral Mamba for Hyperspectral Image Classification
By: Zack Dewis , Yimin Zhu , Zhengsen Xu and more
Potential Business Impact:
Makes computers see details in pictures better.
Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba (Clustering-guided Spatial-Spectral Mamba) framework to better address the challenges, with the following contributions. First, to achieve efficient and adaptive token sequences for improved Mamba performance, we integrate the clustering mechanism into a spatial Mamba architecture, leading to a cluster-guided spatial Mamba module (CSpaMamba) that reduces the Mamba sequence length and improves Mamba feature learning capability. Second, to improve the learning of both spatial and spectral information, we integrate the CSpaMamba module with a spectral mamba module (SpeMamba), leading to a complete clustering-guided spatial-spectral Mamba framework. Third, to further improve feature learning capability, we introduce an Attention-Driven Token Selection mechanism to optimize Mamba token sequencing. Last, to seamlessly integrate clustering into the Mamba model in a coherent manner, we design a Learnable Clustering Module that learns the cluster memberships in an adaptive manner. Experiments on the Pavia University, Indian Pines, and Liao-Ning 01 datasets demonstrate that CSSMamba achieves higher accuracy and better boundary preservation compared to state-of-the-art CNN, Transformer, and Mamba-based methods.
Similar Papers
MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification
CV and Pattern Recognition
Helps computers understand special pictures faster.
Sparse Deformable Mamba for Hyperspectral Image Classification
CV and Pattern Recognition
Helps computers see tiny details in pictures.
Hyperspectral Mamba for Hyperspectral Object Tracking
CV and Pattern Recognition
Tracks objects better using special light colors.