Vitessce Link: A Mixed Reality and 2D Display Hybrid Approach for Visual Analysis of 3D Tissue Maps
By: Eric Mörth , Morgan L. Turner , Cydney Nielsen and more
Potential Business Impact:
Lets doctors see and explore body maps in 3D.
Advances in spatial omics and high-resolution imaging enable the creation of three-dimensional (3D) tissue maps that capture cellular organization and interactions in situ. While these data provide critical insights into tissue function and disease, their exploration is often constrained by tools limited to 2D displays or stereoscopic rendering without analytical integration. We present Vitessce Link, a web-based hybrid framework that unites a 3D stereoscopic view in mixed reality with a synchronized 2D display environment. Users can navigate volumetric data with intuitive hand gestures while controlling channels, filters, and derived data views through the Vitessce platform. Built on open standards and running entirely in the browser, Vitessce Link minimizes friction, supports integration with computational notebooks, and synchronizes interactions across devices via a lightweight WebSocket architecture. Case studies in nephrology and oncology demonstrate how the hybrid approach enhances segmentation evaluation, distance measurement, and interpretation of spatial relationships. Vitessce Link establishes a paradigm for integrative, web-native analysis of 3D tissue maps.
Similar Papers
Interactive visualization of kidney micro-compartmental segmentations and associated pathomics on whole slide images
Quantitative Methods
Shows doctors tiny parts of organs in detail.
mViSE: A Visual Search Engine for Analyzing Multiplex IHC Brain Tissue Images
Image and Video Processing
Finds brain cells and areas without coding.
CvhSlicer 2.0: Immersive and Interactive Visualization of Chinese Visible Human Data in XR Environments
Human-Computer Interaction
See bodies in 3D using a VR headset.