Training and synchronizing oscillator networks with Equilibrium Propagation
By: Théophile Rageau, Julie Grollier
Potential Business Impact:
Trains computer "brains" to recognize pictures.
Oscillator networks represent a promising technology for unconventional computing and artificial intelligence. Thus far, these systems have primarily been demonstrated in small-scale implementations, such as Ising Machines for solving combinatorial problems and associative memories for image recognition, typically trained without state-of-the-art gradient-based algorithms. Scaling up oscillator-based systems requires advanced gradient-based training methods that also ensure robustness against frequency dispersion between individual oscillators. Here, we demonstrate through simulations that the Equilibrium Propagation algorithm enables effective gradient-based training of oscillator networks, facilitating synchronization even when initial oscillator frequencies are significantly dispersed. We specifically investigate two oscillator models: purely phase-coupled oscillators and oscillators coupled via both amplitude and phase interactions. Our results show that these oscillator networks can scale successfully to standard image recognition benchmarks, such as achieving nearly 98\% test accuracy on the MNIST dataset, despite noise introduced by imperfect synchronization. This work thus paves the way for practical hardware implementations of large-scale oscillator networks, such as those based on spintronic devices.
Similar Papers
Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machines
Machine Learning (CS)
Computers learn faster by copying how nature works.
Scalable 28nm IC implementation of coupled oscillator network featuring tunable topology and complexity
Emerging Technologies
Builds brain-like chips for faster problem-solving.
Optimal Control for Network of Coupled Oscillators
Systems and Control
Makes many connected things work together perfectly.