From Ranking to Selection: A Simple but Efficient Dynamic Passage Selector for Retrieval Augmented Generation
By: Siyuan Meng , Junming Liu , Yirong Chen and more
Potential Business Impact:
Helps AI find better answers from many texts.
Retrieval-augmented generation (RAG) systems are often bottlenecked by their reranking modules, which typically score passages independently and select a fixed Top-K size. This approach struggles with complex multi-hop queries that require synthesizing evidence across multiple documents, creating a trade-off where small K values omit crucial information and large K values introduce noise. To address this, we introduce the Dynamic Passage Selector (DPS), a novel reranking framework that treats passage selection as a supervised learning problem. Unlike traditional point-wise or list-wise methods, DPS is fine-tuned to capture inter-passage dependencies and dynamically select the most relevant set of passages for generation. As a seamless plug-and-play module, DPS requires no modifications to the standard RAG pipeline. Comprehensive evaluations on five benchmarks show that DPS consistently outperforms state-of-the-art rerankers and fine-tuning methods. Notably, on the challenging MuSiQue dataset, DPS improves the F1-score by 30.06% and 15.4% over strong baselines like Qwen3-reranker and RankingGPT, respectively. Our results demonstrate that by enabling adaptive evidence selection, DPS substantially enhances reasoning capabilities in complex RAG scenarios.
Similar Papers
Dynamic Context Selection for Retrieval-Augmented Generation: Mitigating Distractors and Positional Bias
Information Retrieval
Finds better answers by choosing the best info.
DynamicRAG: Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generation
Computation and Language
Helps AI pick the best facts for answers.
Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models
Information Retrieval
Helps computers answer questions more accurately.