Confidence-Weighted Semi-Supervised Learning for Skin Lesion Segmentation Using Hybrid CNN-Transformer Networks
By: Saqib Qamar
Potential Business Impact:
Finds skin cancer faster with less doctor notes.
Automated skin lesion segmentation through dermoscopic analysis is essential for early skin cancer detection, yet remains challenging due to limited annotated training data. We present MIRA-U, a semi-supervised framework that combines uncertainty-aware teacher-student pseudo-labeling with a hybrid CNN-Transformer architecture. Our approach employs a teacher network pre-trained via masked image modeling to generate confidence-weighted soft pseudo-labels, which guide a U-shaped CNN-Transformer student network featuring cross-attention skip connections. This design enhances pseudo-label quality and boundary delineation, surpassing reconstruction-based and CNN-only baselines, particularly in low-annotation regimes. Extensive evaluation on ISIC-2016 and PH2 datasets demonstrates superior performance, achieving a Dice Similarity Coefficient (DSC) of 0.9153 and Intersection over Union (IoU) of 0.8552 using only 50% labeled data. Code is publicly available on GitHub.
Similar Papers
Deep Skin Lesion Segmentation with Transformer-CNN Fusion: Toward Intelligent Skin Cancer Analysis
Image and Video Processing
Finds skin cancer spots more accurately.
MedLiteNet: Lightweight Hybrid Medical Image Segmentation Model
CV and Pattern Recognition
Helps doctors find skin cancer faster.
Skin Cancer Classification: Hybrid CNN-Transformer Models with KAN-Based Fusion
CV and Pattern Recognition
Finds skin cancer faster and more accurately.