Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation
By: Xiao He , Huangxuan Zhao , Guojia Wan and more
Potential Business Impact:
Helps doctors find baby problems with ultrasound.
Recent medical vision-language models have shown promise on tasks such as VQA, report generation, and anomaly detection. However, most are adapted to structured adult imaging and underperform in fetal ultrasound, which poses challenges of multi-view image reasoning, numerous diseases, and image diversity. To bridge this gap, we introduce FetalMind, a medical AI system tailored to fetal ultrasound for both report generation and diagnosis. Guided by clinical workflow, we propose Salient Epistemic Disentanglement (SED), which injects an expert-curated bipartite graph into the model to decouple view-disease associations and to steer preference selection along clinically faithful steps via reinforcement learning. This design mitigates variability across diseases and heterogeneity across views, reducing learning bottlenecks while aligning the model's inference with obstetric practice. To train FetalMind at scale, we curate FetalSigma-1M dataset, the first large-scale fetal ultrasound report corpus, comprising 20K reports from twelve medical centers, addressing the scarcity of domain data. Extensive experiments show that FetalMind outperforms open- and closed-source baselines across all gestational stages, achieving +14% average gains and +61.2% higher accuracy on critical conditions while remaining efficient, stable, and scalable. Project Page: https://hexiao0275.github.io/FetalMind.
Similar Papers
UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation
CV and Pattern Recognition
Helps doctors understand ultrasound images better.
Adapting Vision-Language Foundation Model for Next Generation Medical Ultrasound Image Analysis
CV and Pattern Recognition
Helps doctors see inside bodies better with AI.
Biologically Inspired Deep Learning Approaches for Fetal Ultrasound Image Classification
Image and Video Processing
Helps doctors find 16 baby parts in ultrasound.