Case Count Metric for Comparative Analysis of Entity Resolution Results
By: John R. Talburt , Muzakkiruddin Ahmed Mohammed , Mert Can Cakmak and more
Potential Business Impact:
Compares how two computer sorting methods work.
This paper describes a new process and software system, the Case Count Metric System (CCMS), for systematically comparing and analyzing the outcomes of two different ER clustering processes acting on the same dataset when the true linking (labeling) is not known. The CCMS produces a set of counts that describe how the clusters produced by the first process are transformed by the second process based on four possible transformation scenarios. The transformations are that a cluster formed in the first process either remains unchanged, merges into a larger cluster, is partitioned into smaller clusters, or otherwise overlaps with multiple clusters formed in the second process. The CCMS produces a count for each of these cases, accounting for every cluster formed in the first process. In addition, when run in analysis mode, the CCMS program can assist the user in evaluating these changes by displaying the details for all changes or only for certain types of changes. The paper includes a detailed description of the CCMS process and program and examples of how the CCMS has been applied in university and industry research.
Similar Papers
Enhancing Interpretability and Effectiveness in Recommendation with Numerical Features via Learning to Contrast the Counterfactual samples
Information Retrieval
Helps online stores show you better stuff.
Cumulative Consensus Score: Label-Free and Model-Agnostic Evaluation of Object Detectors in Deployment
CV and Pattern Recognition
Checks if computer vision sees things right.
Unifying Information-Theoretic and Pair-Counting Clustering Similarity
Machine Learning (Stat)
Unifies ways to check how well computer groups match.