Learning by Automatic Option Discovery from Conditionally Terminating Sequences

Girgin S., POLAT F., Alhajj R.

17th European Conference on Artificial Intelligence, Riva del Garda, Italy, 28 August 2006, vol.141, pp.494-495 identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 141
  • City: Riva del Garda
  • Country: Italy
  • Page Numbers: pp.494-495
  • Middle East Technical University Affiliated: Yes


This paper proposes a novel approach to discover options in the form of conditionally terminating sequences, and shows how they can be integrated into reinforcement learning framework to improve the learning performance. The method utilizes stored histories of possible optimal policies and constructs a specialized tree structure online in order to identify action sequences which are used frequently together with states that are visited during the execution of such sequences. The tree is then used to implicitly run corresponding options. Effectiveness of the method is demonstrated empirically.