Introduction to Predictive Coding Networks for Machine Learning
By: Mikko Stenlund
Potential Business Impact:
Helps computers learn like brains to see pictures.
Predictive coding networks (PCNs) constitute a biologically inspired framework for understanding hierarchical computation in the brain, and offer an alternative to traditional feedforward neural networks in ML. This note serves as a quick, onboarding introduction to PCNs for machine learning practitioners. We cover the foundational network architecture, inference and learning update rules, and algorithmic implementation. A concrete image-classification task (CIFAR-10) is provided as a benchmark-smashing application, together with an accompanying Python notebook containing the PyTorch implementation.
Similar Papers
Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice
Machine Learning (CS)
Makes AI learn faster and use less power.
Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice
Machine Learning (CS)
Makes AI learn faster and use less energy.
Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations
Machine Learning (CS)
Robots learn faster with less effort.