DpDNet: An Dual-Prompt-Driven Network for Universal PET-CT Segmentation
By: Xinglong Liang , Jiaju Huang , Luyi Han and more
Potential Business Impact:
Helps doctors find cancer better using special computer vision.
PET-CT lesion segmentation is challenging due to noise sensitivity, small and variable lesion morphology, and interference from physiological high-metabolic signals. Current mainstream approaches follow the practice of one network solving the segmentation of multiple cancer lesions by treating all cancers as a single task. However, this overlooks the unique characteristics of different cancer types. Considering the specificity and similarity of different cancers in terms of metastatic patterns, organ preferences, and FDG uptake intensity, we propose DpDNet, a Dual-Prompt-Driven network that incorporates specific prompts to capture cancer-specific features and common prompts to retain shared knowledge. Additionally, to mitigate information forgetting caused by the early introduction of prompts, prompt-aware heads are employed after the decoder to adaptively handle multiple segmentation tasks. Experiments on a PET-CT dataset with four cancer types show that DpDNet outperforms state-of-the-art models. Finally, based on the segmentation results, we calculated MTV, TLG, and SUVmax for breast cancer survival analysis. The results suggest that DpDNet has the potential to serve as a valuable tool for personalized risk stratification, supporting clinicians in optimizing treatment strategies and improving outcomes. Code is available at https://github.com/XinglongLiang08/DpDNet.
Similar Papers
CDPDNet: Integrating Text Guidance with Hybrid Vision Encoders for Medical Image Segmentation
CV and Pattern Recognition
Helps doctors see tumors better in X-rays.
SP-Det: Self-Prompted Dual-Text Fusion for Generalized Multi-Label Lesion Detection
CV and Pattern Recognition
Finds sickness in X-rays without doctors' notes.
Towards Interactive Lesion Segmentation in Whole-Body PET/CT with Promptable Models
CV and Pattern Recognition
Helps doctors find cancer spots faster and better.