Effective Fine-Tuning with Eigenvector Centrality Based Pruning
By: Shaif Chowdhury, Soham Biren Katlariwala, Devleena Kashyap
In social media networks a small number of highly influential users can drive large scale changes in discourse across multiple communities. Small shifts in the behavior of these users are often sufficient to propagate widely throughout the network. A similar phenomenon occurs during neural network fine tuning. Conventional fine tuning of convolutional neural networks typically adds a new linear classification layer on top of a large pre trained model. Instead we argue that improved adaptation can be achieved by first pruning the network to retain only the most important neurons and then performing fine tuning. We propose a graph theory based method for pruning neural networks that is designed to improve fine tuning performance. In this method each neuron is represented as a node and edges encode similarity between neurons. Neurons are pruned based on importance scores computed using eigenvector centrality. The resulting pruned network is then fine tuned using only the most central neurons. We evaluate the proposed method on VGGNet EfficientNet and ResNet models using the TF Flowers Caltech one zero one and Oxford Flowers one zero two datasets. The proposed approach achieves higher classification accuracy while significantly reducing model complexity. On the Oxford Flowers one zero two dataset the method achieves forty eight percent classification accuracy compared to thirty percent accuracy obtained by the baseline VGGNet model.
Similar Papers
Equivariant-Aware Structured Pruning for Efficient Edge Deployment: A Comprehensive Framework with Adaptive Fine-Tuning
CV and Pattern Recognition
Makes AI models smaller and faster for tricky tasks.
Multi-Granular Node Pruning for Circuit Discovery
Artificial Intelligence
Finds tiny brain parts that make AI smart.
Accuracy-Constrained CNN Pruning for Efficient and Reliable EEG-Based Seizure Detection
Machine Learning (CS)
Finds seizures faster with smaller, smarter computer brain.