Optimal Policy Synthesis from A Sequence of Goal Sets with An Application to Electric Distribution System Restoration

Isik I., ARPALI O. Y., AYDIN GÖL E.

7th IFAC Conference on Analysis and Design of Hybrid Systems (ADHS), Brussels, Belçika, 7 - 09 Temmuz 2021, cilt.54, ss.271-276 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 54
  • Doi Numarası: 10.1016/j.ifacol.2021.08.510
  • Basıldığı Şehir: Brussels
  • Basıldığı Ülke: Belçika
  • Sayfa Sayıları: ss.271-276
  • Anahtar Kelimeler: Stochastic systems, Energy and power networks, Specification
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Motivated by the post-disaster distribution system restoration problem, in this paper, we study the problem of synthesizing the optimal policy for a Markov Decision Process (MDP) from a sequence of goal sets. For each goal set, our aim is to both maximize the probability to reach and minimize the expected time to reach the goal set. The order of the goal sets represents their priority. In particular, our aim is to generate a policy that is optimal with respect to the first goal set, and it is optimal with respect to the second goal set among the policies that are optimal with respect to the first goal set and so on. To synthesize such a policy, we iteratively filter the applicable actions according to the goal sets. We illustrate the developed method over a sample distribution system. Copyright (C) 2021 The Authors.