A Scalable Global Optimization Algorithm For Constrained Clustering
By: Pedro Chumpitaz-Flores , My Duong , Cristobal Heredia and more
Potential Business Impact:
Groups data better, even with many rules.
Constrained clustering leverages limited domain knowledge to improve clustering performance and interpretability, but incorporating pairwise must-link and cannot-link constraints is an NP-hard challenge, making global optimization intractable. Existing mixed-integer optimization methods are confined to small-scale datasets, limiting their utility. We propose Sample-Driven Constrained Group-Based Branch-and-Bound (SDC-GBB), a decomposable branch-and-bound (BB) framework that collapses must-linked samples into centroid-based pseudo-samples and prunes cannot-link through geometric rules, while preserving convergence and guaranteeing global optimality. By integrating grouped-sample Lagrangian decomposition and geometric elimination rules for efficient lower and upper bounds, the algorithm attains highly scalable pairwise k-Means constrained clustering via parallelism. Experimental results show that our approach handles datasets with 200,000 samples with cannot-link constraints and 1,500,000 samples with must-link constraints, which is 200 - 1500 times larger than the current state-of-the-art under comparable constraint settings, while reaching an optimality gap of less than 3%. In providing deterministic global guarantees, our method also avoids the search failures that off-the-shelf heuristics often encounter on large datasets.
Similar Papers
A Graph-Partitioning Based Continuous Optimization Approach to Semi-supervised Clustering Problems
Optimization and Control
Finds groups in data without knowing how many.
Constrained Centroid Clustering: A Novel Approach for Compact and Structured Partitioning
Machine Learning (CS)
Groups data points tightly, like a neat circle.
Exponential convergence of a distributed divide-and-conquer algorithm for constrained convex optimization on networks
Optimization and Control
Solves big problems by breaking them into smaller ones.