Dynamics of Structured Complex-Valued Hopfield Neural Networks
By: Rama Murthy Garimella , Marcos Eduardo Valle , Guilherme Vieira and more
Potential Business Impact:
Makes computer memories remember more things.
In this paper, we explore the dynamics of structured complex-valued Hopfield neural networks (CvHNNs), which arise when the synaptic weight matrix possesses specific structural properties. We begin by analyzing CvHNNs with a Hermitian synaptic weight matrix and establish the existence of four-cycle dynamics in CvHNNs with skew-Hermitian weight matrices operating synchronously. Furthermore, we introduce two new classes of complex-valued matrices: braided Hermitian and braided skew-Hermitian matrices. We demonstrate that CvHNNs utilizing these matrix types exhibit cycles of length eight when operating in full parallel update mode. Finally, we conduct extensive computational experiments on synchronous CvHNNs, exploring other synaptic weight matrix structures. The findings provide a comprehensive overview of the dynamics of structured CvHNNs, offering insights that may contribute to developing improved associative memory models when integrated with suitable learning rules.
Similar Papers
Hybrid Real- and Complex-valued Neural Network Architecture
Machine Learning (CS)
Makes computers learn faster with sound.
Towards Quantifying the Hessian Structure of Neural Networks
Machine Learning (CS)
Explains why computer brains learn better with many choices.
Generative System Dynamics in Recurrent Neural Networks
Machine Learning (CS)
Makes computer memory remember longer and better.