Optimal control of stochastic hybrid system with jumps: A numerical approximation

TEMOÇİN B. Z., Weber G.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, cilt.259, ss.443-451, 2014 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 259
  • Basım Tarihi: 2014
  • Doi Numarası: 10.1016/j.cam.2013.10.021
  • Dergi Adı: JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.443-451
  • Anahtar Kelimeler: Stochastic hybrid systems, Jump diffusions, Markov processes, Switching approximation, Optimal control, REACHABILITY
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

The generalized class of stochastic hybrid systems consists of models with regime changes including the occurrence of impulsive behavior. In this paper, the stochastic hybrid processes with jumps are approximated by locally consistent Markov decision processes that preserve local mean and covariance. We further apply a randomized switching policy for approximating the dynamics on the switching boundaries. To investigate the validity of the approximation, we study a stochastic optimal control problem. On the basis of the discrete approximation, we solve the optimal control problem and show that the solution obtained from the discretized problem converges to the solution of the original optimal control problem. (C) 2013 Elsevier B.V. All rights reserved.