Geometric lower bounds for the steady-state occupancy of processing networks with limited connectivity
By: Diego Goldsztajn, Andres Ferragut
Potential Business Impact:
Makes computer networks handle more tasks faster.
We consider processing networks where multiple dispatchers are connected to single-server queues by a bipartite compatibility graph, modeling constraints that are common in data centers and cloud networks due to geographic reasons or data locality issues. We prove lower bounds for the steady-state occupancy, i.e., the complementary cumulative distribution function of the empirical queue length distribution. The lower bounds are geometric with ratios given by two flexibility metrics: the average degree of the dispatchers and a novel metric that averages the minimum degree over the compatible dispatchers across the servers. Using these lower bounds, we establish that the asymptotic performance of a growing processing network cannot match that of the classic Power-of-$d$ or JSQ policies unless the flexibility metrics approach infinity in the large-scale limit.
Similar Papers
Dispatching Odyssey: Exploring Performance in Computing Clusters under Real-world Workloads
Distributed, Parallel, and Cluster Computing
Makes computers finish jobs faster by smarter organizing.
Uncovering the topology of an infinite-server queueing network from population data
Probability
Helps understand how many people are waiting.
Stability and Heavy-traffic Delay Optimality of General Load Balancing Policies in Heterogeneous Service Systems
Performance
Makes jobs go to the right computer faster.