High-Dimensional Change Point Detection using Graph Spanning Ratio
By: Youngwen Sun, Katerina Papagiannouli, Vladimir Spokoiny
Potential Business Impact:
Finds hidden changes in data quickly and accurately.
Inspired by graph-based methodologies, we introduce a novel graph-spanning algorithm designed to identify changes in both offline and online data across low to high dimensions. This versatile approach is applicable to Euclidean and graph-structured data with unknown distributions, while maintaining control over error probabilities. Theoretically, we demonstrate that the algorithm achieves high detection power when the magnitude of the change surpasses the lower bound of the minimax separation rate, which scales on the order of $\sqrt{nd}$. Our method outperforms other techniques in terms of accuracy for both Gaussian and non-Gaussian data. Notably, it maintains strong detection power even with small observation windows, making it particularly effective for online environments where timely and precise change detection is critical.
Similar Papers
Multiscale Change Point Detection for Functional Time Series
Statistics Theory
Finds many changes hidden in data streams.
Change-Point Detection With Multivariate Repeated Measures
Methodology
Finds changes in data with many people.
Change-Point Detection Utilizing Normalized Entropy as a Fundamental Metric
Applications
Finds sudden changes in data patterns.