Network Topology and Information Efficiency of Multi-Agent Systems: Study based on MARL
By: Xinren Zhang , Sixi Cheng , Zixin Zhong and more
Potential Business Impact:
Teams of robots learn to work together better.
Multi-agent systems (MAS) solve complex problems through coordinated autonomous entities with individual decision-making capabilities. While Multi-Agent Reinforcement Learning (MARL) enables these agents to learn intelligent strategies, it faces challenges of non-stationarity and partial observability. Communications among agents offer a solution, but questions remain about its optimal structure and evaluation. This paper explores two underexamined aspects: communication topology and information efficiency. We demonstrate that directed and sequential topologies improve performance while reducing communication overhead across both homogeneous and heterogeneous tasks. Additionally, we introduce two metrics -- Information Entropy Efficiency Index (IEI) and Specialization Efficiency Index (SEI) -- to evaluate message compactness and role differentiation. Incorporating these metrics into training objectives improves success rates and convergence speed. Our findings highlight that designing adaptive communication topologies with information-efficient messaging is essential for effective coordination in complex MAS.
Similar Papers
Learning Efficient Communication Protocols for Multi-Agent Reinforcement Learning
Multiagent Systems
Teaches robots to talk smarter, work better together.
Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey
Machine Learning (CS)
Helps self-driving cars learn to work together.
Toward Goal-Oriented Communication in Multi-Agent Systems: An overview
Multiagent Systems
Helps robots work together smarter with less talking.