Stealthy LLM-Driven Data Poisoning Attacks Against Embedding-Based Retrieval-Augmented Recommender Systems
By: Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia and more
Potential Business Impact:
Makes fake reviews trick recommendation systems.
We present a systematic study of provider-side data poisoning in retrieval-augmented recommender systems (RAG-based). By modifying only a small fraction of tokens within item descriptions -- for instance, adding emotional keywords or borrowing phrases from semantically related items -- an attacker can significantly promote or demote targeted items. We formalize these attacks under token-edit and semantic-similarity constraints, and we examine their effectiveness in both promotion (long-tail items) and demotion (short-head items) scenarios. Our experiments on MovieLens, using two large language model (LLM) retrieval modules, show that even subtle attacks shift final rankings and item exposures while eluding naive detection. The results underscore the vulnerability of RAG-based pipelines to small-scale metadata rewrites and emphasize the need for robust textual consistency checks and provenance tracking to thwart stealthy provider-side poisoning.
Similar Papers
Practical Poisoning Attacks against Retrieval-Augmented Generation
Cryptography and Security
Makes AI smarter and harder to trick.
One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems
Cryptography and Security
Makes AI trust wrong information from one bad source.
Retrieval-Augmented Review Generation for Poisoning Recommender Systems
Cryptography and Security
Makes fake reviews trick movie suggestion systems.