Cooperative multi-agent learning: The state of the art

被引:679
作者
Panait, L [1 ]
Luke, S [1 ]
机构
[1] George Mason Univ, Dept Comp Sci, Fairfax, VA 22030 USA
关键词
multi-agent systems; machine learning; multi-agent learning; cooperation; survey;
D O I
10.1007/s10458-005-2631-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cooperative multi-agent systems (MAS) are ones in which several agents attempt, through their interaction, to jointly solve tasks or to maximize utility. Due to the interactions among the agents, multi-agent problem complexity can rise rapidly with the number of agents or their behavioral sophistication. The challenge this presents to the task of programming solutions to MAS problems has spawned increasing interest in machine learning techniques to automate the search and optimization process. We provide a broad survey of the cooperative multi-agent learning literature. Previous surveys of this area have largely focused on issues common to specific subareas (for example, reinforcement learning, RL or robotics). In this survey we attempt to draw from multi-agent learning work in a spectrum of areas, including RL, evolutionary computation, game theory, complex systems, agent modeling, and robotics. We find that this broad view leads to a division of the work into two categories, each with its own special issues: applying a single learner to discover joint solutions to multi-agent problems (team learning), or using multiple simultaneous learners, often one per agent (concurrent learning). Additionally, we discuss direct and indirect communication in connection with learning, plus open issues in task decomposition, scalability, and adaptive dynamics. We conclude with a presentation of multi-agent learning problem domains, and a list of multi-agent learning resources.
引用
收藏
页码:387 / 434
页数:48
相关论文
共 313 条
[1]  
ACKLEY DH, 1994, ARTIFICIAL LIFE, V4
[2]  
ANDRE D, 1996, GENETIC PROGRAMMING
[3]  
ANDRE D, 1999, ROBOCUP 98 ROBOT SOC, V2
[4]  
ANGELINE PJ, 1993, PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON GENETIC ALGORITHMS, P264
[5]  
[Anonymous], KOGNITIONSWISSENSCHA
[6]  
[Anonymous], GEN EV COMP C GECCO
[7]  
[Anonymous], 2000, IIS0010
[8]  
[Anonymous], P 9 IEEE INT C FUZZ
[9]  
[Anonymous], P 5 INT C AUT AG
[10]  
[Anonymous], 1998, THESIS GEORGIA I TEC