Spatio-Temporal Cluster-Triggered Encoding for Spiking Neural Networks
By: Lingyun Ke, Minchi Hu
Potential Business Impact:
Makes computers see and understand pictures better.
Encoding static images into spike trains is a crucial step for enabling Spiking Neural Networks (SNNs) to process visual information efficiently. However, existing schemes such as rate coding, Poisson encoding, and time-to-first-spike (TTFS) often ignore spatial relationships and yield temporally inconsistent spike patterns. In this article, a novel cluster-based encoding approach is proposed, which leverages local density computation to preserve semantic structure in both spatial and temporal domains. This method introduces a 2D spatial cluster trigger that identifies foreground regions through connected component analysis and local density estimation. Then, extend to a 3D spatio-temporal (ST3D) framework that jointly considers temporal neighborhoods, producing spike trains with improved temporal consistency. Experiments on the N-MNIST dataset demonstrate that our ST3D encoder achieves 98.17% classification accuracy with a simple single-layer SNN, outperforming standard TTFS encoding (97.58%) and matching the performance of more complex deep architectures while using significantly fewer spikes (~3800 vs ~5000 per sample). The results demonstrate that this approach provides an interpretable and efficient encoding strategy for neuromorphic computing applications.
Similar Papers
Revisiting Direct Encoding: Learnable Temporal Dynamics for Static Image Spiking Neural Networks
Neural and Evolutionary Computing
Makes computers "see" moving pictures from still ones.
Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
Neural and Evolutionary Computing
Makes AI see better with less power.
Spatial Spiking Neural Networks Enable Efficient and Robust Temporal Computation
Neural and Evolutionary Computing
Makes smart computers learn faster with less memory.