Human or LLM as Standardized Patients? A Comparative Study for Medical Education
By: Bingquan Zhang , Xiaoxiao Liu , Yuchi Wang and more
Potential Business Impact:
Trains doctors better than real people, cheaper.
Standardized Patients (SP) are indispensable for clinical skills training but remain expensive, inflexible, and difficult to scale. Existing large-language-model (LLM)-based SP simulators promise lower cost yet show inconsistent behavior and lack rigorous comparison with human SP. We present EasyMED, a multi-agent framework combining a Patient Agent for realistic dialogue, an Auxiliary Agent for factual consistency, and an Evaluation Agent that delivers actionable feedback. To support systematic assessment, we introduce SPBench, a benchmark of real SP-doctor interactions spanning 14 specialties and eight expert-defined evaluation criteria. Experiments demonstrate that EasyMED matches human SP learning outcomes while producing greater skill gains for lower-baseline students and offering improved flexibility, psychological safety, and cost efficiency.
Similar Papers
A Voice-Enabled Virtual Patient System for Interactive Training in Standardized Clinical Assessment
Human-Computer Interaction
Trains doctors to help people using fake patients.
LLM-Powered Virtual Patient Agents for Interactive Clinical Skills Training with Automated Feedback
Human-Computer Interaction
Lets doctors practice real patient visits at home.
AI Standardized Patient Improves Human Conversations in Advanced Cancer Care
Human-Computer Interaction
Teaches doctors to talk about hard things better.