A History Tree Heuristic to Generate Better Initiation Sets for Options in Reinforcement Learning

DEMİR A., Cilden E., POLAT F.

22nd European Conference on Artificial Intelligence (ECAI), Hague, Netherlands, 29 August - 02 September 2016, vol.285, pp.1644-1645 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 285
  • Doi Number: 10.3233/978-1-61499-672-9-1644
  • City: Hague
  • Country: Netherlands
  • Page Numbers: pp.1644-1645
  • Middle East Technical University Affiliated: Yes

Abstract

Options framework is a prominent way to improve learning speed by means of temporally extended actions, called options. Although various attempts focusing on how to derive high quality termination conditions for options exist, the impact of initiation set generation of an option is relatively unexplored. In this work, we propose an effective heuristic method to derive useful initiation set elements via an analysis of the recent history of events.