SocraticAI: Transforming LLMs into Guided CS Tutors Through Scaffolded Interaction
By: Karthik Sunil, Aalok Thakkar
Potential Business Impact:
Teaches students to use AI smartly for learning.
We present SocraticAI, a scaffolded AI tutoring system that integrates large language models (LLMs) into undergraduate Computer Science education through structured constraints rather than prohibition. The system enforces well-formulated questions, reflective engagement, and daily usage limits while providing Socratic dialogue scaffolds. Unlike traditional AI bans, our approach cultivates responsible and strategic AI interaction skills through technical guardrails, including authentication, query validation, structured feedback, and RAG-based course grounding. Initial deployment demonstrates that students progress from vague help-seeking to sophisticated problem decomposition within 2-3 weeks, with over 75% producing substantive reflections and displaying emergent patterns of deliberate, strategic AI use.
Similar Papers
Exploring Conversational Design Choices in LLMs for Pedagogical Purposes: Socratic and Narrative Approaches for Improving Instructor's Teaching Practice
Human-Computer Interaction
Helps teachers learn to use AI better.
Discerning minds or generic tutors? Evaluating instructional guidance capabilities in Socratic LLMs
Computation and Language
Teaches computers to help students learn better.
Resurrecting Socrates in the Age of AI: A Study Protocol for Evaluating a Socratic Tutor to Support Research Question Development in Higher Education
Computers and Society
AI tutor helps students ask better questions.