HaDM-ST: Histology-Assisted Differential Modeling for Spatial Transcriptomics Generation
By: Xuepeng Liu , Zheng Jiang , Pinan Zhu and more
Potential Business Impact:
Makes cell maps show tiny details better.
Spatial transcriptomics (ST) reveals spatial heterogeneity of gene expression, yet its resolution is limited by current platforms. Recent methods enhance resolution via H&E-stained histology, but three major challenges persist: (1) isolating expression-relevant features from visually complex H&E images; (2) achieving spatially precise multimodal alignment in diffusion-based frameworks; and (3) modeling gene-specific variation across expression channels. We propose HaDM-ST (Histology-assisted Differential Modeling for ST Generation), a high-resolution ST generation framework conditioned on H&E images and low-resolution ST. HaDM-ST includes: (i) a semantic distillation network to extract predictive cues from H&E; (ii) a spatial alignment module enforcing pixel-wise correspondence with low-resolution ST; and (iii) a channel-aware adversarial learner for fine-grained gene-level modeling. Experiments on 200 genes across diverse tissues and species show HaDM-ST consistently outperforms prior methods, enhancing spatial fidelity and gene-level coherence in high-resolution ST predictions.
Similar Papers
Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matching
CV and Pattern Recognition
Shows where genes are in cells faster.
Img2ST-Net: Efficient High-Resolution Spatial Omics Prediction from Whole Slide Histology Images via Fully Convolutional Image-to-Image Learning
CV and Pattern Recognition
Makes expensive cell maps from cheap pictures.
Digital Modeling of Spatial Pathway Activity from Histology Reveals Tumor Microenvironment Heterogeneity
Quantitative Methods
Finds cancer signals in regular tissue pictures.