General Multi-User Distributed Computing
By: Ali Khalesi
Potential Business Impact:
Helps many computers work together smarter.
This work develops a unified {learning- and information-theoretic} framework for distributed computation and inference across multiple users and servers. The proposed \emph{General Multi-User Distributed Computing (GMUDC)} model characterizes how computation, communication, and accuracy can be jointly optimized when users demand heterogeneous target functions that are arbitrary transformations of shared real-valued subfunctions. Without any separability assumption, and requiring only that each target function lies in a reproducing-kernel Hilbert space associated with a shift-invariant kernel, the framework remains valid for arbitrary connectivity and task-assignment topologies. A dual analysis is introduced: the \emph{quenched design} considers fixed assignments of subfunctions and network topology, while the \emph{annealed design} captures the averaged performance when assignments and links are drawn uniformly at random from a given ensemble. These formulations reveal the fundamental limits governing the trade-offs among computing load, communication load, and reconstruction distortion under computational and communication budgets~$Γ$ and~$Δ$. The analysis establishes a spectral-coverage duality linking generalization capability with network topology and resource allocation, leading to provably efficient and topology-aware distributed designs. The resulting principles provide an \emph{information-energy foundation} for scalable and resource-optimal distributed and federated learning systems, with direct applications to aeronautical, satellite, and edge-intelligent networks where energy and data efficiency are critical.
Similar Papers
Typical Solutions of Multi-User Linearly-Decomposable Distributed Computing
Information Theory
Helps planes and satellites share information better.
Adaptive Multiple Access and Service Placement for Generative Diffusion Models
Networking and Internet Architecture
Makes AI art creation faster on phones.
Adaptive Multiple Access and Service Placement for Generative Diffusion Models
Networking and Internet Architecture
Makes AI art creation faster on phones.