Enhancing Communication Efficiency in FL with Adaptive Gradient Quantization and Communication Frequency Optimization
By: Asadullah Tariq , Tariq Qayyum , Mohamed Adel Serhani and more
Potential Business Impact:
Makes phones train AI without sharing private info.
Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces a major bottleneck due to high communication overhead from frequent model updates between devices and the server, limiting deployment in resource-constrained wireless networks. In this paper, we propose a three-fold strategy. Firstly, an Adaptive Feature-Elimination Strategy to drop less important features while retaining high-value ones; secondly, Adaptive Gradient Innovation and Error Sensitivity-Based Quantization, which dynamically adjusts the quantization level for innovative gradient compression; and thirdly, Communication Frequency Optimization to enhance communication efficiency. We evaluated our proposed model's performance through extensive experiments, assessing accuracy, loss, and convergence compared to baseline techniques. The results show that our model achieves high communication efficiency in the framework while maintaining accuracy.
Similar Papers
Communication-Efficient Zero-Order and First-Order Federated Learning Methods over Wireless Networks
Machine Learning (CS)
Makes phones learn together without sharing secrets.
Caching Techniques for Reducing the Communication Cost of Federated Learning in IoT Environments
Distributed, Parallel, and Cluster Computing
Smarter sharing makes AI learn faster, cheaper.
Optimal Batch-Size Control for Low-Latency Federated Learning with Device Heterogeneity
Machine Learning (CS)
Makes smart devices learn faster, privately.