Score: 0

Kernel Representation and Similarity Measure for Incomplete Data

Published: October 15, 2025 | arXiv ID: 2510.13352v1

By: Yang Cao , Sikun Yang , Kai He and more

Potential Business Impact:

Finds patterns in messy, missing information.

Business Areas:
Predictive Analytics Artificial Intelligence, Data and Analytics, Software

Measuring similarity between incomplete data is a fundamental challenge in web mining, recommendation systems, and user behavior analysis. Traditional approaches either discard incomplete data or perform imputation as a preprocessing step, leading to information loss and biased similarity estimates. This paper presents the proximity kernel, a new similarity measure that directly computes similarity between incomplete data in kernel feature space without explicit imputation in the original space. The proposed method introduces data-dependent binning combined with proximity assignment to project data into a high-dimensional sparse representation that adapts to local density variations. For missing value handling, we propose a cascading fallback strategy to estimate missing feature distributions. We conduct clustering tasks on the proposed kernel representation across 12 real world incomplete datasets, demonstrating superior performance compared to existing methods while maintaining linear time complexity. All the code are available at https://anonymous.4open.science/r/proximity-kernel-2289.

Page Count
9 pages

Category
Computer Science:
Machine Learning (CS)