Cycle-Consistent Multi-Graph Matching for Self-Supervised Annotation of C.Elegans
By: Christoph Karg , Sebastian Stricker , Lisa Hutschenreiter and more
Potential Business Impact:
Maps cells in worm images without human help.
In this work we present a novel approach for unsupervised multi-graph matching, which applies to problems for which a Gaussian distribution of keypoint features can be assumed. We leverage cycle consistency as loss for self-supervised learning, and determine Gaussian parameters through Bayesian Optimization, yielding a highly efficient approach that scales to large datasets. Our fully unsupervised approach enables us to reach the accuracy of state-of-the-art supervised methodology for the biomedical use case of semantic cell annotation in 3D microscopy images of the worm C. elegans. To this end, our approach yields the first unsupervised atlas of C. elegans, i.e. a model of the joint distribution of all of its cell nuclei, without the need for any ground truth cell annotation. This advancement enables highly efficient semantic annotation of cells in large microscopy datasets, overcoming a current key bottleneck. Beyond C. elegans, our approach offers fully unsupervised construction of cell-level atlases for any model organism with a stereotyped body plan down to the level of unique semantic cell labels, and thus bears the potential to catalyze respective biomedical studies in a range of further species.
Similar Papers
CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy
CV and Pattern Recognition
Teaches computers to see cells without examples.
Leveraging Cycle-Consistent Anchor Points for Self-Supervised RGB-D Registration
CV and Pattern Recognition
Helps computers understand 3D spaces from pictures.
Self-Supervised Spatial Correspondence Across Modalities
CV and Pattern Recognition
Matches points in different kinds of pictures.