State Similarity Based Approach for Improving Performance in RL


Girgin S., POLAT F., Alhajj R.

20th International Joint Conference on Artificial Intelligence, Hyderabad, Pakistan, 6 - 12 Ocak 2007, ss.817-822 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Hyderabad
  • Basıldığı Ülke: Pakistan
  • Sayfa Sayıları: ss.817-822
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

This paper employs state similarity to improve reinforcement learning performance. This is achieved by first identifying states with similar sub-policies. Then, a tree is constructed to be used for locating common action sequences of states as derived from possible optimal policies. Such sequences are utilized for defining a similarity function between states, which is essential for reflecting updates on the action-value function of a state onto all similar states. As a result, the experience acquired during learning can be applied to a broader context. Effectiveness of the method is demonstrated empirically.