Foreground-aware Virtual Staining for Accurate 3D Cell Morphological Profiling
By: Alexandr A. Kalinin , Paula Llanos , Theresa Maria Sommer and more
Potential Business Impact:
Makes cell pictures clearer without dyes.
Microscopy enables direct observation of cellular morphology in 3D, with transmitted-light methods offering low-cost, minimally invasive imaging and fluorescence microscopy providing specificity and contrast. Virtual staining combines these strengths by using machine learning to predict fluorescence images from label-free inputs. However, training of existing methods typically relies on loss functions that treat all pixels equally, thus reproducing background noise and artifacts instead of focusing on biologically meaningful signals. We introduce Spotlight, a simple yet powerful virtual staining approach that guides the model to focus on relevant cellular structures. Spotlight uses histogram-based foreground estimation to mask pixel-wise loss and to calculate a Dice loss on soft-thresholded predictions for shape-aware learning. Applied to a 3D benchmark dataset, Spotlight improves morphological representation while preserving pixel-level accuracy, resulting in virtual stains better suited for downstream tasks such as segmentation and profiling.
Similar Papers
A Value Mapping Virtual Staining Framework for Large-scale Histological Imaging
Image and Video Processing
Makes microscope pictures look like they were stained.
Generative AI for Misalignment-Resistant Virtual Staining to Accelerate Histopathology Workflows
CV and Pattern Recognition
Makes digital scans look like real tissue samples.
Virtual staining for 3D X-ray histology of bone implants
Image and Video Processing
Makes 3D X-rays look like stained tissue.