MixReasoning: Switching Modes to Think
By: Haiquan Lu , Gongfan Fang , Xinyin Ma and more
Potential Business Impact:
Smart AI learns faster by skipping easy steps.
Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step introduces substantial redundancy, as sub-problems vary widely in difficulty and complexity: a small number of pivotal steps are genuinely challenging and decisive for the final answer, while many others only involve straightforward revisions or simple computations. Therefore, a natural idea is to endow reasoning models with the ability to adaptively respond to this variation, rather than treating all steps with the same level of elaboration. To this end, we propose MixReasoning, a framework that dynamically adjusts the depth of reasoning within a single response. The resulting chain of thought then becomes a mixture of detailed reasoning on difficult steps and concise inference on simpler ones. Experiments on GSM8K, MATH-500, and AIME show that MixReasoning shortens reasoning length and substantially improves efficiency without compromising accuracy.
Similar Papers
RLAD: Training LLMs to Discover Abstractions for Solving Reasoning Problems
Artificial Intelligence
Helps computers solve hard problems by learning steps.
From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
Artificial Intelligence
Computers change how they think based on how hard a problem is.
Think in Blocks: Adaptive Reasoning from Direct Response to Deep Reasoning
Artificial Intelligence
Lets AI think smarter, not harder.