Score: 1

Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers

Published: June 12, 2025 | arXiv ID: 2506.10486v2

By: Xanh Ho , Sunisth Kumar , Yun-Ang Wu and more

Potential Business Impact:

Shows how computers find proof in tables.

Business Areas:
Text Analytics Data and Analytics, Software

Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table. However, we argue that predicting the final label alone is insufficient: it reveals little about the model's reasoning and offers limited interpretability. To address this, we reframe table-text alignment as an explanation task, requiring models to identify the table cells essential for claim verification. We build a new dataset by extending the SciTab benchmark with human-annotated cell-level rationales. Annotators verify the claim label and highlight the minimal set of cells needed to support their decision. After the annotation process, we utilize the collected information and propose a taxonomy for handling ambiguous cases. Our experiments show that (i) incorporating table alignment information improves claim verification performance, and (ii) most LLMs, while often predicting correct labels, fail to recover human-aligned rationales, suggesting that their predictions do not stem from faithful reasoning.

Country of Origin
πŸ‡―πŸ‡΅ πŸ‡«πŸ‡· πŸ‡ΉπŸ‡Ό Japan, France, Taiwan, Province of China

Page Count
9 pages

Category
Computer Science:
Computation and Language