Tight Bounds for Heavy-Hitters and Moment Estimation in the Sliding Window Model
By: Shiyuan Feng, William Swartworth, David P. Woodruff
Potential Business Impact:
Finds important items in fast-moving data streams.
We consider the heavy-hitters and $F_p$ moment estimation problems in the sliding window model. For $F_p$ moment estimation with $1<p\leq 2$, we show that it is possible to give a $(1\pm \epsilon)$ multiplicative approximation to the $F_p$ moment with $2/3$ probability on any given window of size $n$ using $\tilde{O}(\frac{1}{\epsilon^p}\log^2 n + \frac{1}{\epsilon^2}\log n)$ bits of space. We complement this result with a lower bound showing that our algorithm gives tight bounds up to factors of $\log\log n$ and $\log\frac{1}{\epsilon}.$ As a consequence of our $F_2$ moment estimation algorithm, we show that the heavy-hitters problem can be solved on an arbitrary window using $O(\frac{1}{\epsilon^2}\log^2 n)$ space which is tight.
Similar Papers
Tight Bounds for Low-Error Frequency Moment Estimation and the Power of Multiple Passes
Data Structures and Algorithms
Stores data streams more efficiently for better analysis.
Fair Clustering in the Sliding Window Model
Data Structures and Algorithms
Makes computer groups fairer, even with changing data.
Unbiased Insights: Optimal Streaming Algorithms for $\ell_p$ Sampling, the Forget Model, and Beyond
Data Structures and Algorithms
Finds patterns in huge data streams using less space.