Understanding the Thinking Process of Reasoning Models: A Perspective from Schoenfeld's Episode Theory
By: Ming Li , Nan Zhang , Chenrui Fan and more
Potential Business Impact:
Helps understand how AI thinks through problems.
While Large Reasoning Models (LRMs) generate extensive chain-of-thought reasoning, we lack a principled framework for understanding how these thoughts are structured. In this paper, we introduce a novel approach by applying Schoenfeld's Episode Theory, a classic cognitive framework for human mathematical problem-solving, to analyze the reasoning traces of LRMs. We annotated thousands of sentences and paragraphs from model-generated solutions to math problems using seven cognitive labels (e.g., Plan, Implement, Verify). The result is the first publicly available benchmark for the fine-grained analysis of machine reasoning, including a large annotated corpus and detailed annotation guidebooks. Our preliminary analysis reveals distinct patterns in LRM reasoning, such as the transition dynamics between cognitive states. This framework provides a theoretically grounded methodology for interpreting LRM cognition and enables future work on more controllable and transparent reasoning systems.
Similar Papers
Schoenfeld's Anatomy of Mathematical Reasoning by Language Models
Computation and Language
Shows how AI "thinks" step-by-step.
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
Artificial Intelligence
Helps computers think better, but they still make mistakes.
Modeling Hierarchical Thinking in Large Reasoning Models
Artificial Intelligence
Helps computers think step-by-step like people.