AITutor-EvalKit: Exploring the Capabilities of AI Tutors
By: Numaan Naeem , Kaushal Kumar Maurya , Kseniia Petukhova and more
Potential Business Impact:
Checks if AI teachers help students learn well.
We present AITutor-EvalKit, an application that uses language technology to evaluate the pedagogical quality of AI tutors, provides software for demonstration and evaluation, as well as model inspection and data visualization. This tool is aimed at education stakeholders as well as *ACL community at large, as it supports learning and can also be used to collect user feedback and annotations.
Similar Papers
An Experience Report on a Pedagogically Controlled, Curriculum-Constrained AI Tutor for SE Education
Computers and Society
AI tutor helps students learn to code better.
AI Conversational Tutors in Foreign Language Learning: A Mixed-Methods Evaluation Study
Human-Computer Interaction
Teaches you languages better with smart computer helpers.
Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systems
Computation and Language
Creates fair tests for AI tutors.