From Coverage to Prestige: A Comprehensive Assessment of Large-Scale Scientometric Data
By: Guoyang Rong , Ying Chen , Thorsten Koch and more
Potential Business Impact:
Makes research data more complete and accurate.
As research in the Scientometric deepens, the impact of data quality on research outcomes has garnered increasing attention. This study, based on Web of Science (WoS) and Crossref datasets, systematically evaluates the differences between data sources and the effects of data merging through matching, comparison, and integration. Two core metrics were employed: Reference Coverage Rate (RCR) and Article Scientific Prestige (ASP), which respectively measure citation completeness (quantity) and academic influence (quality). The results indicate that the WoS dataset outperforms Crossref in its coverage of high-impact literature and ASP scores, while the Crossref dataset provides complementary value through its broader coverage of literature. Data merging significantly improves the completeness of the citation network, with particularly pronounced benefits in smaller disciplinary clusters such as Education and Arts. However, data merging also introduces some low-quality citations, resulting in a polarization of overall data quality. Moreover, the impact of data merging varies across disciplines; high-impact clusters such as Science, Biology, and Medicine benefit the most, whereas clusters like Social Sciences and Arts are more vulnerable to negative effects. This study highlights the critical role of data sources in Scientometric research and provides a framework for assessing and improving data quality.
Similar Papers
Investigating Document Type, Language, Publication Year, and Author Count Discrepancies Between OpenAlex and Web of Science
Digital Libraries
Improves science data for better research tracking.
Integrating Large Citation Datasets
Digital Libraries
Finds which science ideas are most important.
Comprehensive Manuscript Assessment with Text Summarization Using 69707 articles
Computation and Language
Predicts how much a science paper will be read.