Rethinking Popularity Bias in Collaborative Filtering via Analytical Vector Decomposition
By: Lingfeng Liu , Yixin Song , Dazhong Shen and more
Potential Business Impact:
Finds hidden gems, not just popular stuff.
Popularity bias fundamentally undermines the personalization capabilities of collaborative filtering (CF) models, causing them to disproportionately recommend popular items while neglecting users' genuine preferences for niche content. While existing approaches treat this as an external confounding factor, we reveal that popularity bias is an intrinsic geometric artifact of Bayesian Pairwise Ranking (BPR) optimization in CF models. Through rigorous mathematical analysis, we prove that BPR systematically organizes item embeddings along a dominant "popularity direction" where embedding magnitudes directly correlate with interaction frequency. This geometric distortion forces user embeddings to simultaneously handle two conflicting tasks-expressing genuine preference and calibrating against global popularity-trapping them in suboptimal configurations that favor popular items regardless of individual tastes. We propose Directional Decomposition and Correction (DDC), a universally applicable framework that surgically corrects this embedding geometry through asymmetric directional updates. DDC guides positive interactions along personalized preference directions while steering negative interactions away from the global popularity direction, disentangling preference from popularity at the geometric source. Extensive experiments across multiple BPR-based architectures demonstrate that DDC significantly outperforms state-of-the-art debiasing methods, reducing training loss to less than 5% of heavily-tuned baselines while achieving superior recommendation quality and fairness. Code is available in https://github.com/LingFeng-Liu-AI/DDC.
Similar Papers
Post-hoc Popularity Bias Correction in GNN-based Collaborative Filtering
Information Retrieval
Fixes bad movie suggestions from popular choices.
On the Role of Weight Decay in Collaborative Filtering: A Popularity Perspective
Information Retrieval
Makes movie suggestions better and faster.
Representation Quantization for Collaborative Filtering Augmentation
Information Retrieval
Finds better movie and product matches for you.