A layered approach to learning coordination knowledge in multiagent environments

Erus G., Polat F.

APPLIED INTELLIGENCE, vol.27, no.3, pp.249-267, 2007 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 27 Issue: 3
  • Publication Date: 2007
  • Doi Number: 10.1007/s10489-006-0034-y
  • Journal Name: APPLIED INTELLIGENCE
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.249-267
  • Middle East Technical University Affiliated: Yes

Abstract

Multiagent learning involves acquisition of cooperative behavior among intelligent agents in order to satisfy the joint goals. Reinforcement Learning (RL) is a promising unsupervised machine learning technique inspired from the earlier studies in animal learning. In this paper, we propose a new RL technique called the Two Level Reinforcement Learning with Communication (2LRL) method to provide cooperative action selection in a multiagent environment. In 2LRL, learning takes place in two hierarchical levels; in the first level agents learn to select their target and then they select the action directed to their target in the second level. The agents communicate their perception to their neighbors and use the communication information in their decision-making. We applied 2LRL method in a hunter-prey environment and observed a satisfactory cooperative behavior.