SimClinician: A Multimodal Simulation Testbed for Reliable Psychologist AI Collaboration in Mental Health Diagnosis
By: Filippo Cenacchi, Longbing Cao, Deborah Richards
Potential Business Impact:
Helps doctors trust AI for mental health.
AI based mental health diagnosis is often judged by benchmark accuracy, yet in practice its value depends on how psychologists respond whether they accept, adjust, or reject AI suggestions. Mental health makes this especially challenging: decisions are continuous and shaped by cues in tone, pauses, word choice, and nonverbal behaviors of patients. Current research rarely examines how AI diagnosis interface design influences these choices, leaving little basis for reliable testing before live studies. We present SimClinician, an interactive simulation platform, to transform patient data into psychologist AI collaborative diagnosis. Contributions include: (1) a dashboard integrating audio, text, and gaze-expression patterns; (2) an avatar module rendering de-identified dynamics for analysis; (3) a decision layer that maps AI outputs to multimodal evidence, letting psychologists review AI reasoning, and enter a diagnosis. Tested on the E-DAIC corpus (276 clinical interviews, expanded to 480,000 simulations), SimClinician shows that a confirmation step raises acceptance by 23%, keeping escalations below 9%, and maintaining smooth interaction flow.
Similar Papers
MedSimAI: Simulation and Formative Feedback Generation to Enhance Deliberate Practice in Medical Education
Computers and Society
Teaches doctors to talk to patients better.
A Voice-Enabled Virtual Patient System for Interactive Training in Standardized Clinical Assessment
Human-Computer Interaction
Trains doctors to help people using fake patients.
MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
Computation and Language
Tests AI mental health helpers for real problems.