Prototype-Guided Cross-Modal Knowledge Enhancement for Adaptive Survival Prediction
By: Fengchun Liu , Linghan Cai , Zhikang Wang and more
Potential Business Impact:
Helps doctors predict sickness with less patient info.
Histo-genomic multimodal survival prediction has garnered growing attention for its remarkable model performance and potential contributions to precision medicine. However, a significant challenge in clinical practice arises when only unimodal data is available, limiting the usability of these advanced multimodal methods. To address this issue, this study proposes a prototype-guided cross-modal knowledge enhancement (ProSurv) framework, which eliminates the dependency on paired data and enables robust learning and adaptive survival prediction. Specifically, we first introduce an intra-modal updating mechanism to construct modality-specific prototype banks that encapsulate the statistics of the whole training set and preserve the modality-specific risk-relevant features/prototypes across intervals. Subsequently, the proposed cross-modal translation module utilizes the learned prototypes to enhance knowledge representation for multimodal inputs and generate features for missing modalities, ensuring robust and adaptive survival prediction across diverse scenarios. Extensive experiments on four public datasets demonstrate the superiority of ProSurv over state-of-the-art methods using either unimodal or multimodal input, and the ablation study underscores its feasibility for broad applicability. Overall, this study addresses a critical practical challenge in computational pathology, offering substantial significance and potential impact in the field.
Similar Papers
Multimodal Feature Prototype Learning for Interpretable and Discriminative Cancer Survival Prediction
CV and Pattern Recognition
Helps doctors predict cancer survival better.
MultiSurv: A Multimodal Deep Survival Framework for Prostrate and Bladder Cancer
Machine Learning (CS)
Predicts when cancer might return for patients.
Adaptive Prototype Learning for Multimodal Cancer Survival Analysis
Image and Video Processing
Helps doctors predict cancer survival better.