Fundamental Limits of Coded Polynomial Aggregation
By: Xi Zhong, Jörg Kliewer, Mingyue Ji
Coded polynomial aggregation (CPA) enables the master to directly recover a weighted aggregation of polynomial evaluations without individually decoding each term, thereby reducing the number of required worker responses. In this paper, we extend CPA to straggler-aware distributed computing systems and introduce a straggler-aware CPA framework with pre-specified non-straggler patterns, where exact recovery is required only for a given collection of admissible non-straggler sets. Our main result shows that exact recovery of the desired aggregation is achievable with fewer worker responses than required by polynomial coded computing based on individual decoding, and that feasibility is fundamentally characterized by the intersection structure of the non-straggler patterns. In particular, we establish necessary and sufficient conditions for exact recovery in straggler-aware CPA and identify an intersection-size threshold that is sufficient to guarantee exact recovery. We further prove that this threshold becomes both necessary and sufficient when the number of admissible non-straggler sets is sufficiently large. We also provide an explicit construction of feasible CPA schemes whenever the intersection size exceeds the derived threshold. Finally, simulations reveal a sharp feasibility transition at the predicted threshold, providing empirical evidence that the bound is tight in practice.
Similar Papers
General Coded Computing in a Probabilistic Straggler Regime
Distributed, Parallel, and Cluster Computing
Makes slow computers finish tasks faster.
Computer-aided Characterization of Fundamental Limits of Coded Caching with Linear Coding
Information Theory
Makes wireless internet faster and more reliable.
Multivariate Polynomial Codes for Efficient Matrix Chain Multiplication in Distributed Systems
Information Theory
Makes computers finish big math problems faster.