Learning by Automatic Option Discovery from Conditionally Terminating Sequences


Girgin S., POLAT F., Alhajj R.

17th European Conference on Artificial Intelligence, Riva del Garda, İtalya, 28 Ağustos 2006, cilt.141, ss.494-495 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 141
  • Basıldığı Şehir: Riva del Garda
  • Basıldığı Ülke: İtalya
  • Sayfa Sayıları: ss.494-495
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

This paper proposes a novel approach to discover options in the form of conditionally terminating sequences, and shows how they can be integrated into reinforcement learning framework to improve the learning performance. The method utilizes stored histories of possible optimal policies and constructs a specialized tree structure online in order to identify action sequences which are used frequently together with states that are visited during the execution of such sequences. The tree is then used to implicitly run corresponding options. Effectiveness of the method is demonstrated empirically.