Beyond Personalization: Federated Recommendation with Calibration via Low-rank Decomposition
By: Jundong Chen , Honglei Zhang , Haoxuan Li and more
Potential Business Impact:
Keeps your movie picks private, still suggests good movies.
Federated recommendation (FR) is a promising paradigm to protect user privacy in recommender systems. Distinct from general federated scenarios, FR inherently needs to preserve client-specific parameters, i.e., user embeddings, for privacy and personalization. However, we empirically find that globally aggregated item embeddings can induce skew in user embeddings, resulting in suboptimal performance. To this end, we theoretically analyze the user embedding skew issue and propose Personalized Federated recommendation with Calibration via Low-Rank decomposition (PFedCLR). Specifically, PFedCLR introduces an integrated dual-function mechanism, implemented with a buffer matrix, to jointly calibrate local user embedding and personalize global item embeddings. To ensure efficiency, we employ a low-rank decomposition of the buffer matrix to reduce the model overhead. Furthermore, for privacy, we train and upload the local model before personalization, preventing the server from accessing sensitive information. Extensive experiments demonstrate that PFedCLR effectively mitigates user embedding skew and achieves a desirable trade-off among performance, efficiency, and privacy, outperforming state-of-the-art (SOTA) methods.
Similar Papers
A Model-agnostic Strategy to Mitigate Embedding Degradation in Personalized Federated Recommendation
Information Retrieval
Keeps your movie picks private and better.
Federated Latent Factor Model for Bias-Aware Recommendation with Privacy-Preserving
Machine Learning (CS)
Keeps your private data safe while recommending things.
Breaking the Aggregation Bottleneck in Federated Recommendation: A Personalized Model Merging Approach
Distributed, Parallel, and Cluster Computing
Keeps movie suggestions personal when learning together.