UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation
By: Yue Li , Qing Xu , Yixuan Zhang and more
Potential Business Impact:
Helps doctors see inside bodies better with sound.
The Segment Anything Model 2 (SAM2) demonstrates remarkable universal segmentation capabilities on natural images. However, its performance on ultrasound images is significantly degraded due to domain disparities. This limitation raises two critical challenges: how to efficiently adapt SAM2 to ultrasound imaging while maintaining parameter efficiency, and how to deploy the adapted model effectively in resource-constrained clinical environments. To address these issues, we propose UniUltra for universal ultrasound segmentation. Specifically, we first introduce a novel context-edge hybrid adapter (CH-Adapter) that enhances fine-grained perception across diverse ultrasound imaging modalities while achieving parameter-efficient fine-tuning. To further improve clinical applicability, we develop a deep-supervised knowledge distillation (DSKD) technique that transfers knowledge from the large image encoder of the fine-tuned SAM2 to a super lightweight encoder, substantially reducing computational requirements without compromising performance. Extensive experiments demonstrate that UniUltra outperforms state-of-the-arts with superior generalization capabilities. Notably, our framework achieves competitive performance using only 8.91% of SAM2's parameters during fine-tuning, and the final compressed model reduces the parameter count by 94.08% compared to the original SAM2, making it highly suitable for practical clinical deployment. The source code is available at https://github.com/xq141839/UniUltra.
Similar Papers
SAM2-UNeXT: An Improved High-Resolution Baseline for Adapting Foundation Models to Downstream Segmentation Tasks
CV and Pattern Recognition
Makes computer pictures understand objects better.
SAM3-UNet: Simplified Adaptation of Segment Anything Model 3
CV and Pattern Recognition
Teaches computers to find things in pictures faster.
SAM2-3dMed: Empowering SAM2 for 3D Medical Image Segmentation
Image and Video Processing
Helps doctors see inside bodies better.