GENERATING EFFECTIVE INITIATION SETS FOR SUBGOAL-DRIVEN OPTIONS

DEMİR A., Cilden E., POLAT F.

ADVANCES IN COMPLEX SYSTEMS, cilt.22, sa.2, 2019 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 22 Sayı: 2
  • Basım Tarihi: 2019
  • Doi Numarası: 10.1142/s0219525919500012
  • Dergi Adı: ADVANCES IN COMPLEX SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Anahtar Kelimeler: Reinforcement learning, options framework, option initiation set, subgoal discovery, Markov decision process, REINFORCEMENT, CUT
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Options framework is one of the prominent models serving as a basis to improve learning speed by means of temporal abstractions. An option is mainly composed of three elements: initiation set, option's local policy and termination condition. Although various attempts exist that focus on how to derive high-quality termination conditions for a given problem, the impact of initiation set generation is relatively unexplored. In this work, we propose an effective goal-oriented heuristic method to derive useful initiation set elements via an analysis of the recent history of events. Effectiveness of the method is experimented on various benchmark problems, and the results are discussed.