Rethinking Schema Linking: A Context-Aware Bidirectional Retrieval Approach for Text-to-SQL
By: Md Mahadi Hasan Nahid , Davood Rafiei , Weiwei Zhang and more
Potential Business Impact:
Helps computers find the right data for questions.
Schema linking -- the process of aligning natural language questions with database schema elements -- is a critical yet underexplored component of Text-to-SQL systems. While recent methods have focused primarily on improving SQL generation, they often neglect the retrieval of relevant schema elements, which can lead to hallucinations and execution failures. In this work, we propose a context-aware bidirectional schema retrieval framework that treats schema linking as a standalone problem. Our approach combines two complementary strategies: table-first retrieval followed by column selection, and column-first retrieval followed by table selection. It is further augmented with techniques such as question decomposition, keyword extraction, and keyphrase extraction. Through comprehensive evaluations on challenging benchmarks such as BIRD and Spider, we demonstrate that our method significantly improves schema recall while reducing false positives. Moreover, SQL generation using our retrieved schema consistently outperforms full-schema baselines and closely approaches oracle performance, all without requiring query refinement. Notably, our method narrows the performance gap between full and perfect schema settings by 50\%. Our findings highlight schema linking as a powerful lever for enhancing Text-to-SQL accuracy and efficiency.
Similar Papers
X-SQL: Expert Schema Linking and Understanding of Text-to-SQL with Multi-LLMs
Machine Learning (CS)
Helps computers understand questions to get data.
AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scale
Computation and Language
Helps computers understand databases without seeing them all.
Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Task
Artificial Intelligence
Helps computers understand data questions better.