KG-Augmented Executable CoT for Mathematical Coding
By: Xingyu Chen , Junxiu An , Jun Guo and more
Potential Business Impact:
Helps computers solve math and write code better.
In recent years, large language models (LLMs) have excelled in natural language processing tasks but face significant challenges in complex reasoning tasks such as mathematical reasoning and code generation. To address these limitations, we propose KG-Augmented Executable Chain-of-Thought (KGA-ECoT), a novel framework that enhances code generation through knowledge graphs and improves mathematical reasoning via executable code. KGA-ECoT decomposes problems into a Structured Task Graph, leverages efficient GraphRAG for precise knowledge retrieval from mathematical libraries, and generates verifiable code to ensure computational accuracy. Evaluations on multiple mathematical reasoning benchmarks demonstrate that KGA-ECoT significantly outperforms existing prompting methods, achieving absolute accuracy improvements ranging from several to over ten percentage points. Further analysis confirms the critical roles of GraphRAG in enhancing code quality and external code execution in ensuring precision. These findings collectively establish KGA-ECoT as a robust and highly generalizable framework for complex mathematical reasoning tasks.
Similar Papers
Scaling Code-Assisted Chain-of-Thoughts and Instructions for Model Reasoning
Computation and Language
Makes computers think better by checking their steps.
CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language Models
Computation and Language
Makes AI think better and more reliably.
Bridging Formal Language with Chain-of-Thought Reasoning to Geometry Problem Solving
Machine Learning (CS)
Helps computers solve math problems with pictures.