Planning for Success: Exploring LLM Long-term Planning Capabilities in Table Understanding
By: Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung and more
Potential Business Impact:
Helps computers understand tables to answer questions.
Table understanding is key to addressing challenging downstream tasks such as table-based question answering and fact verification. Recent works have focused on leveraging Chain-of-Thought and question decomposition to solve complex questions requiring multiple operations on tables. However, these methods often suffer from a lack of explicit long-term planning and weak inter-step connections, leading to miss constraints within questions. In this paper, we propose leveraging the long-term planning capabilities of large language models (LLMs) to enhance table understanding. Our approach enables the execution of a long-term plan, where the steps are tightly interconnected and serve the ultimate goal, an aspect that methods based on Chain-of-Thought and question decomposition lack. In addition, our method effectively minimizes the inclusion of unnecessary details in the process of solving the next short-term goals, a limitation of methods based on Chain-of-Thought. Extensive experiments demonstrate that our method outperforms strong baselines and achieves state-of-the-art performance on WikiTableQuestions and TabFact datasets.
Similar Papers
Improving Table Understanding with LLMs and Entity-Oriented Search
Computation and Language
Helps computers understand information in tables better.
Idea2Plan: Exploring AI-Powered Research Planning
Computation and Language
Helps computers plan science experiments from ideas.
TransientTables: Evaluating LLMs' Reasoning on Temporally Evolving Semi-structured Tables
Computation and Language
Helps computers understand how things change over time.