Score: 0

An Adaptive Sampling Framework for Detecting Localized Concept Drift under Label Scarcity

Published: November 4, 2025 | arXiv ID: 2511.02452v1

By: Junghee Pyeon, Davide Cacciarelli, Kamran Paynabar

Potential Business Impact:

Finds hidden changes in data to improve predictions.

Business Areas:
Predictive Analytics Artificial Intelligence, Data and Analytics, Software

Concept drift and label scarcity are two critical challenges limiting the robustness of predictive models in dynamic industrial environments. Existing drift detection methods often assume global shifts and rely on dense supervision, making them ill-suited for regression tasks with local drifts and limited labels. This paper proposes an adaptive sampling framework that combines residual-based exploration and exploitation with EWMA monitoring to efficiently detect local concept drift under labeling budget constraints. Empirical results on synthetic benchmarks and a case study on electricity market demonstrate superior performance in label efficiency and drift detection accuracy.

Page Count
29 pages

Category
Statistics:
Machine Learning (Stat)