Think How Your Teammates Think: Active Inference Can Benefit Decentralized Execution
By: Hao Wu , Shoucheng Song , Chang Yao and more
Potential Business Impact:
Lets robots learn to work together without talking.
In multi-agent systems, explicit cognition of teammates' decision logic serves as a critical factor in facilitating coordination. Communication (i.e., ``\textit{Tell}'') can assist in the cognitive development process by information dissemination, yet it is inevitably subject to real-world constraints such as noise, latency, and attacks. Therefore, building the understanding of teammates' decisions without communication remains challenging. To address this, we propose a novel non-communication MARL framework that realizes the construction of cognition through local observation-based modeling (i.e., \textit{``Think''}). Our framework enables agents to model teammates' \textbf{active inference} process. At first, the proposed method produces three teammate portraits: perception-belief-action. Specifically, we model the teammate's decision process as follows: 1) Perception: observing environments; 2) Belief: forming beliefs; 3) Action: making decisions. Then, we selectively integrate the belief portrait into the decision process based on the accuracy and relevance of the perception portrait. This enables the selection of cooperative teammates and facilitates effective collaboration. Extensive experiments on the SMAC, SMACv2, MPE, and GRF benchmarks demonstrate the superior performance of our method.
Similar Papers
Theory of Mind Using Active Inference: A Framework for Multi-Agent Cooperation
Artificial Intelligence
Lets AI robots cooperate by guessing others' thoughts from actions
Theory of Mind Using Active Inference: A Framework for Multi-Agent Cooperation
Artificial Intelligence
Lets robots guess friends' goals to team up better
Implicit Coordination using Active Epistemic Inference for Multi-Robot Systems
Robotics
Robots guess what others think to work together.