When Avatars Have Personality: Effects on Engagement and Communication in Immersive Medical Training
By: Julia S. Dollis , Iago A. Brito , Fernanda B. Färber and more
Potential Business Impact:
Makes virtual doctors act like real people.
While virtual reality (VR) excels at simulating physical environments, its effectiveness for training complex interpersonal skills is limited by a lack of psychologically plausible virtual humans. This is a critical gap in high-stakes domains like medical education, where communication is a core competency. This paper introduces a framework that integrates large language models (LLMs) into immersive VR to create medically coherent virtual patients with distinct, consistent personalities, built on a modular architecture that decouples personality from clinical data. We evaluated our system in a mixed-method, within-subjects study with licensed physicians who engaged in simulated consultations. Results demonstrate that the approach is not only feasible but is also perceived by physicians as a highly rewarding and effective training enhancement. Furthermore, our analysis uncovers critical design principles, including a ``realism-verbosity paradox" where less communicative agents can seem more artificial, and the need for challenges to be perceived as authentic to be instructive. This work provides a validated framework and key insights for developing the next generation of socially intelligent VR training environments.
Similar Papers
Designing VR Simulation System for Clinical Communication Training with LLMs-Based Embodied Conversational Agents
Human-Computer Interaction
Teaches doctors to talk to patients better.
A Voice-Enabled Virtual Patient System for Interactive Training in Standardized Clinical Assessment
Human-Computer Interaction
Trains doctors to help people using fake patients.
How LLMs are Shaping the Future of Virtual Reality
Human-Computer Interaction
Makes game characters smarter and stories more exciting.