Unlocking Mixed Reality for Medical Education: A See-Through Perspective on Head Anatomy
By: Yuqing Wei , Yupeng Wang , Jiayi Zhao and more
Potential Business Impact:
Teaches doctors anatomy with virtual body parts.
Extended reality (XR), encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), is emerging as a transformative platform for medical education. Traditional methods such as textbooks, physical models, and cadaveric dissections often lack interactivity and fail to convey complex spatial relationships effectively. The emerging MR technology addresses these limitations by providing immersive environments that blend virtual elements with real-world contexts. This study presents an MR application for head anatomy education, enabling learners to intuitively interact with see-through 3D anatomical structures via hand gestures and controllers. Our hierarchical information design supports progressive learning, guiding users from basic anatomical labels to detailed structural insights. Additionally, the system incorporates an automatic calibration module that aligns virtual anatomical models with a real human head, thereby facilitating realistic human-model interactions. Experiments show that the system can effectively match the anatomical model with real-time scenes, thus enhancing the interactivity and immersion of medical education, providing an innovative tool for teaching anatomy.
Similar Papers
Towards Effective Immersive Technologies in Medicine: Potential and Future Applications based on VR, AR, XR and AI solutions
Human-Computer Interaction
Makes doctors better at helping sick people.
A Desktop-Centric Design Space for Direct Object Examination and Visualization in Mixed-Reality Environments
Human-Computer Interaction
Lets doctors see inside bodies in 3D.
Towards the target and not beyond: 2D vs 3D visual aids in MR-based neurosurgical simulation
Graphics
Improves brain surgery skills without special glasses.