Recommender systems, stigmergy, and the tyranny of popularity
By: Zackary Okun Dunivin, Paul E. Smaldino
Potential Business Impact:
Helps find new ideas, not just popular ones.
Scientific recommender systems, such as Google Scholar and Web of Science, are essential tools for discovery. Search algorithms that power work through stigmergy, a collective intelligence mechanism that surfaces useful paths through repeated engagement. While generally effective, this "rich-get-richer" dynamic results in a small number of high-profile papers that dominate visibility. This essay argues argue that these algorithm over-reliance on popularity fosters intellectual homogeneity and exacerbates structural inequities, stifling innovative and diverse perspectives critical for scientific progress. We propose an overhaul of search platforms to incorporate user-specific calibration, allowing researchers to manually adjust the weights of factors like popularity, recency, and relevance. We also advise platform developers on how text embeddings and LLMs could be implemented in ways that increase user autonomy. While our suggestions are particularly pertinent to aligning recommender systems with scientific values, these ideas are broadly applicable to information access systems in general. Designing platforms that increase user autonomy is an important step toward more robust and dynamic information
Similar Papers
Looking for Fairness in Recommender Systems
Information Retrieval
Helps social media show you new ideas.
Investigating Popularity Bias Amplification in Recommender Systems Employed in the Entertainment Domain
Information Retrieval
Fixes unfair movie and music suggestions.
Recent Advances and Trends in Research Paper Recommender Systems: A Comprehensive Survey
Information Retrieval
Finds the best science papers for you faster.