A History Tree Heuristic to Generate Better Initiation Sets for Options in Reinforcement Learning

DEMİR A. , Cilden E., POLAT F.

22nd European Conference on Artificial Intelligence (ECAI), Hague, Hollanda, 29 Ağustos - 02 Eylül 2016, cilt.285, ss.1644-1645 identifier identifier

  • Cilt numarası: 285
  • Doi Numarası: 10.3233/978-1-61499-672-9-1644
  • Basıldığı Şehir: Hague
  • Basıldığı Ülke: Hollanda
  • Sayfa Sayıları: ss.1644-1645


Options framework is a prominent way to improve learning speed by means of temporally extended actions, called options. Although various attempts focusing on how to derive high quality termination conditions for options exist, the impact of initiation set generation of an option is relatively unexplored. In this work, we propose an effective heuristic method to derive useful initiation set elements via an analysis of the recent history of events.