Gaming the Metrics? Bibliometric Anomalies and the Integrity Crisis in Global University Rankings
By: Lokman I. Meho
Potential Business Impact:
Finds fake research to improve university ratings.
Global university rankings have reshaped how academic success is defined, incentivizing metrics such as publication counts and citation rates at the expense of scholarly integrity. This study examines 18 universities in India, Lebanon, Saudi Arabia, and the United Arab Emirates, selected from among the world's 1,000 most-publishing institutions for their extraordinary research growth and sharp declines in first and corresponding authorship. These institutions exhibit bibliometric patterns consistent with strategic metric optimization, including publication surges of up to 965%, a proliferation of hyper-prolific authors, dense reciprocal co-authorship and citation networks, elevated shares of output in delisted journals, and rising retraction rates. These patterns are analyzed in light of Goodhart's Law and institutional isomorphism, illustrating how performance pressures can reshape academic behavior. To systematically assess and monitor such risks, the study introduces the Research Integrity Risk Index (RI2), a composite indicator based on retraction rates and reliance on delisted journals. RI2 effectively identifies institutions with bibliometric profiles that diverge from global norms and may warrant closer examination. The findings highlight the urgent need for integrity-sensitive reforms in how rankings, funders, and institutions assess scholarly performance.
Similar Papers
Curbing the Ramifications of Authorship Abuse in Science
Digital Libraries
Fairly counts who really helped with science work.
Rethinking Review Citations: Impact on Scientific Integrity
Digital Libraries
Makes sure real science gets credit, not just summaries.
Content-aware rankings: a new approach to rankings in scholarship
Digital Libraries
Ranks universities by how often their research is used.