Histology-informed tiling of whole tissue sections improves the interpretability and predictability of cancer relapse and genetic alterations
By: Willem Bonnaffé , Yang Hu , Andrea Chatrian and more
Potential Business Impact:
Finds cancer patterns in tissue pictures.
Histopathologists establish cancer grade by assessing histological structures, such as glands in prostate cancer. Yet, digital pathology pipelines often rely on grid-based tiling that ignores tissue architecture. This introduces irrelevant information and limits interpretability. We introduce histology-informed tiling (HIT), which uses semantic segmentation to extract glands from whole slide images (WSIs) as biologically meaningful input patches for multiple-instance learning (MIL) and phenotyping. Trained on 137 samples from the ProMPT cohort, HIT achieved a gland-level Dice score of 0.83 +/- 0.17. By extracting 380,000 glands from 760 WSIs across ICGC-C and TCGA-PRAD cohorts, HIT improved MIL models AUCs by 10% for detecting copy number variation (CNVs) in genes related to epithelial-mesenchymal transitions (EMT) and MYC, and revealed 15 gland clusters, several of which were associated with cancer relapse, oncogenic mutations, and high Gleason. Therefore, HIT improved the accuracy and interpretability of MIL predictions, while streamlining computations by focussing on biologically meaningful structures during feature extraction.
Similar Papers
From Pixels to Histopathology: A Graph-Based Framework for Interpretable Whole Slide Image Analysis
Image and Video Processing
Helps doctors diagnose diseases faster from tissue pictures.
Cross-Modality Learning for Predicting IHC Biomarkers from H&E-Stained Whole-Slide Images
Image and Video Processing
Predicts cancer protein spots from regular tissue pictures.
Automating tumor-infiltrating lymphocyte assessment in breast cancer histopathology images using QuPath: a transparent and accessible machine learning pipeline
Quantitative Methods
Helps doctors count cancer-fighting cells in tumors.