Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers
By: Xanh Ho , Sunisth Kumar , Yun-Ang Wu and more
Potential Business Impact:
Shows how computers find proof in tables.
Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table. However, we argue that predicting the final label alone is insufficient: it reveals little about the model's reasoning and offers limited interpretability. To address this, we reframe table-text alignment as an explanation task, requiring models to identify the table cells essential for claim verification. We build a new dataset by extending the SciTab benchmark with human-annotated cell-level rationales. Annotators verify the claim label and highlight the minimal set of cells needed to support their decision. After the annotation process, we utilize the collected information and propose a taxonomy for handling ambiguous cases. Our experiments show that (i) incorporating table alignment information improves claim verification performance, and (ii) most LLMs, while often predicting correct labels, fail to recover human-aligned rationales, suggesting that their predictions do not stem from faithful reasoning.
Similar Papers
Atomic Reasoning for Scientific Table Claim Verification
Computation and Language
Helps computers check science facts from tables.
Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data
Computation and Language
Computers understand data in tables better.
Format Matters: The Robustness of Multimodal LLMs in Reviewing Evidence from Tables and Charts
Computation and Language
Helps computers check science facts from charts.