Uni-Hema: Unified Model for Digital Hematopathology
By: Abdul Rehman , Iqra Rasool , Ayesha Imran and more
Potential Business Impact:
Helps doctors diagnose blood diseases faster and better.
Digital hematopathology requires cell-level analysis across diverse disease categories, including malignant disorders (e.g., leukemia), infectious conditions (e.g., malaria), and non-malignant red blood cell disorders (e.g., sickle cell disease). Whether single-task, vision-language, WSI-optimized, or single-cell hematology models, these approaches share a key limitation, they cannot provide unified, multi-task, multi-modal reasoning across the complexities of digital hematopathology. To overcome these limitations, we propose Uni-Hema, a multi-task, unified model for digital hematopathology integrating detection, classification, segmentation, morphology prediction, and reasoning across multiple diseases. Uni-Hema leverages 46 publicly available datasets, encompassing over 700K images and 21K question-answer pairs, and is built upon Hema-Former, a multimodal module that bridges visual and textual representations at the hierarchy level for the different tasks (detection, classification, segmentation, morphology, mask language modeling and visual question answer) at different granularity. Extensive experiments demonstrate that Uni-Hema achieves comparable or superior performance to train on a single-task and single dataset models, across diverse hematological tasks, while providing interpretable, morphologically relevant insights at the single-cell level. Our framework establishes a new standard for multi-task and multi-modal digital hematopathology. The code will be made publicly available.
Similar Papers
Adaptive Multi-Scale Integration Unlocks Robust Cell Annotation in Histopathology Images
CV and Pattern Recognition
Helps doctors identify cell types for better disease understanding.
Multi-Modal Foundation Models for Computational Pathology: A Survey
CV and Pattern Recognition
Helps doctors understand disease from images and text.
SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptome
CV and Pattern Recognition
Helps doctors see how cells work together.