SlimEdge: Lightweight Distributed DNN Deployment on Constrained Hardware
By: Mahadev Sunil Kumar , Arnab Raha , Debayan Das and more
Potential Business Impact:
Makes smart cameras work faster on small devices.
Deep distributed networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts and computational demands. Here, we present an approach to the efficient deployment of distributed DNNs that jointly respects hardware limitations and preserves task performance. Our method integrates a structured model pruning with a multi-objective optimization to tailor network capacity to heterogeneous device constraints. We demonstrate this framework using Multi-View Convolutional Neural Network (MVCNN), a state-of-the-art architecture for 3D object recognition, by quantifying the contribution of individual views to classification accuracy and allocating pruning budgets, respectively. Experimental results show that the resulting models satisfy user-specified bounds on accuracy and memory footprint while reducing inference latency by factors ranging from 1.2x to 5.0x across diverse hardware platforms. These findings suggest that performance-aware, view-adaptive compression provides a viable pathway for deploying complex vision models in distributed edge environments.
Similar Papers
Rethinking Inference Placement for Deep Learning across Edge and Cloud Platforms: A Multi-Objective Optimization Perspective and Future Directions
Distributed, Parallel, and Cluster Computing
Makes smart apps run faster and safer.
Edge Intelligence with Spiking Neural Networks
Distributed, Parallel, and Cluster Computing
Makes smart devices learn without internet.
A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edge
Distributed, Parallel, and Cluster Computing
Keeps your pictures private when using smart apps.