If We May De-Presuppose: Robustly Verifying Claims through Presupposition-Free Question Decomposition
By: Shubhashis Roy Dipta, Francis Ferraro
Potential Business Impact:
Makes AI answers more truthful and reliable.
Prior work has shown that presupposition in generated questions can introduce unverified assumptions, leading to inconsistencies in claim verification. Additionally, prompt sensitivity remains a significant challenge for large language models (LLMs), resulting in performance variance as high as 3-6%. While recent advancements have reduced this gap, our study demonstrates that prompt sensitivity remains a persistent issue. To address this, we propose a structured and robust claim verification framework that reasons through presupposition-free, decomposed questions. Extensive experiments across multiple prompts, datasets, and LLMs reveal that even state-of-the-art models remain susceptible to prompt variance and presupposition. Our method consistently mitigates these issues, achieving up to a 2-5% improvement.
Similar Papers
Decomposition-Enhanced Training for Post-Hoc Attributions In Language Models
Computation and Language
Helps AI show where it found answers.
More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering
Computation and Language
Helps AI better answer tricky questions by thinking.
Knowing What's Missing: Assessing Information Sufficiency in Question Answering
Computation and Language
Helps computers know when they don't know answers.