Parameter efficient hybrid spiking-quantum convolutional neural network with surrogate gradient and quantum data-reupload
By: Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam and more
Potential Business Impact:
Trains smarter AI using less computer power.
The rapid advancement of artificial intelligence (AI) and deep learning (DL) has catalyzed the emergence of several optimization-driven subfields, notably neuromorphic computing and quantum machine learning. Leveraging the differentiable nature of hybrid models, researchers have explored their potential to address complex problems through unified optimization strategies. One such development is the Spiking Quantum Neural Network (SQNN), which combines principles from spiking neural networks (SNNs) and quantum computing. However, existing SQNN implementations often depend on pretrained SNNs due to the non-differentiable nature of spiking activity and the limited scalability of current SNN encoders. In this work, we propose a novel architecture, Spiking-Quantum Data Re-upload Convolutional Neural Network (SQDR-CNN), that enables joint training of convolutional SNNs and quantum circuits within a single backpropagation framework. Unlike its predecessor, SQDR-CNN allow convergence to reasonable performance without the reliance of pretrained spiking encoder and subsetting datasets. We also clarified some theoretical foundations, testing new design using quantum data-reupload with different training algorithm-initialization and evaluate the performance of the proposed model under noisy simulated quantum environments. As a result, we were able to achieve 86% of the mean top-performing accuracy of the SOTA SNN baselines, yet uses only 0.5% of the smallest spiking model's parameters. Through this integration of neuromorphic and quantum paradigms, we aim to open new research directions and foster technological progress in multi-modal, learnable systems.
Similar Papers
The Enduring Dominance of Deep Neural Networks: A Critical Analysis of the Fundamental Limitations of Quantum Machine Learning and Spiking Neural Networks
Neural and Evolutionary Computing
Computers learn better with current methods.
Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generation
Quantum Physics
Builds smarter AI without needing special quantum computers.
Brain-Inspired Quantum Neural Architectures for Pattern Recognition: Integrating QSNN and QLSTM
Emerging Technologies
Finds fake credit card charges like a brain.