A Message Passing Realization of Expected Free Energy Minimization
By: Wouter W. L. Nuijten , Mykola Lukashchuk , Thijs van de Laar and more
Potential Business Impact:
Helps robots learn and explore better.
We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic priors, we transform a combinatorial search problem into a tractable inference problem solvable through standard variational techniques. Applying our message passing method to factorized state-space models enables efficient policy inference. We evaluate our method on environments with epistemic uncertainty: a stochastic gridworld and a partially observable Minigrid task. Agents using our approach consistently outperform conventional KL-control agents on these tasks, showing more robust planning and efficient exploration under uncertainty. In the stochastic gridworld environment, EFE-minimizing agents avoid risky paths, while in the partially observable minigrid setting, they conduct more systematic information-seeking. This approach bridges active inference theory with practical implementations, providing empirical evidence for the efficiency of epistemic priors in artificial agents.
Similar Papers
Expected Free Energy-based Planning as Variational Inference
Machine Learning (Stat)
Helps robots learn to explore and achieve goals.
Active Inference is a Subtype of Variational Inference
Artificial Intelligence
Helps smart machines learn and explore better.
Active Inference in Discrete State Spaces from First Principles
Artificial Intelligence
Helps brains learn by guessing and checking.