Enhancing Multilingual RAG Systems with Debiased Language Preference-Guided Query Fusion
By: Jeonghyun Park , Byeongjeong Kim , Seojin Hwang and more
Potential Business Impact:
Makes computers understand all languages equally well.
Multilingual Retrieval-Augmented Generation (mRAG) systems often exhibit a perceived preference for high-resource languages, particularly English, resulting in the widespread adoption of English pivoting. While prior studies attribute this advantage to the superior English-centric capabilities of Large Language Models (LLMs), we find that such measurements are significantly distorted by structural priors inherent in evaluation benchmarks. Specifically, we identify exposure bias and a gold availability prior-both driven by the disproportionate concentration of resources in English-as well as cultural priors rooted in topic locality, as factors that hinder accurate assessment of genuine language preference. To address these biases, we propose DeLP (Debiased Language Preference), a calibrated metric designed to explicitly factor out these structural confounds. Our analysis using DeLP reveals that the previously reported English preference is largely a byproduct of evidence distribution rather than an inherent model bias. Instead, we find that retrievers fundamentally favor monolingual alignment between the query and the document language. Building on this insight, we introduce DELTA (DEbiased Language preference-guided Text Augmentation), a lightweight and efficient mRAG framework that strategically leverages monolingual alignment to optimize cross-lingual retrieval and generation. Experimental results demonstrate that DELTA consistently outperforms English pivoting and mRAG baselines across diverse languages.
Similar Papers
Investigating Language Preference of Multilingual RAG Systems
Computation and Language
Makes AI understand and answer in many languages.
Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAG
Computation and Language
Computers sometimes pick English answers even when wrong.
Language Drift in Multilingual Retrieval-Augmented Generation: Characterization and Decoding-Time Mitigation
Computation and Language
Stops AI from switching languages during translation.