CCSD: Cross-Modal Compositional Self-Distillation for Robust Brain Tumor Segmentation with Missing Modalities
By: Dongqing Xie , Yonghuang Wu , Zisheng Ai and more
Potential Business Impact:
Helps doctors find brain tumors even with missing scans.
The accurate segmentation of brain tumors from multi-modal MRI is critical for clinical diagnosis and treatment planning. While integrating complementary information from various MRI sequences is a common practice, the frequent absence of one or more modalities in real-world clinical settings poses a significant challenge, severely compromising the performance and generalizability of deep learning-based segmentation models. To address this challenge, we propose a novel Cross-Modal Compositional Self-Distillation (CCSD) framework that can flexibly handle arbitrary combinations of input modalities. CCSD adopts a shared-specific encoder-decoder architecture and incorporates two self-distillation strategies: (i) a hierarchical modality self-distillation mechanism that transfers knowledge across modality hierarchies to reduce semantic discrepancies, and (ii) a progressive modality combination distillation approach that enhances robustness to missing modalities by simulating gradual modality dropout during training. Extensive experiments on public brain tumor segmentation benchmarks demonstrate that CCSD achieves state-of-the-art performance across various missing-modality scenarios, with strong generalization and stability.
Similar Papers
No Modality Left Behind: Adapting to Missing Modalities via Knowledge Distillation for Brain Tumor Segmentation
CV and Pattern Recognition
Helps doctors find brain tumors even with missing scans.
DC-Seg: Disentangled Contrastive Learning for Brain Tumor Segmentation with Missing Modalities
CV and Pattern Recognition
Helps doctors see brain tumors with missing scans.
Confidence-Aware Self-Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
Machine Learning (CS)
Helps computers understand feelings even with missing info.