From NLG Evaluation to Modern Student Assessment in the Era of ChatGPT: The Great Misalignment Problem and Pedagogical Multi-Factor Assessment (P-MFA)
By: Mika Hämäläinen, Kimmo Leiviskä
Potential Business Impact:
Helps teachers grade student writing fairly with AI.
This paper explores the growing epistemic parallel between NLG evaluation and grading of students in a Finnish University. We argue that both domains are experiencing a Great Misalignment Problem. As students increasingly use tools like ChatGPT to produce sophisticated outputs, traditional assessment methods that focus on final products rather than learning processes have lost their validity. To address this, we introduce the Pedagogical Multi-Factor Assessment (P-MFA) model, a process-based, multi-evidence framework inspired by the logic of multi-factor authentication.
Similar Papers
How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responses
Computers and Society
Helps teachers spot cheating in student writing.
Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design
Computers and Society
Shows how students use AI for schoolwork.
Educators on the Frontline: Philosophical and Realistic Perspectives on Integrating ChatGPT into the Learning Space
Computers and Society
Helps teachers use AI to improve learning.