Optimal control of stochastic hybrid system with jumps: A numerical approximation


TEMOÇİN B. Z. , Weber G.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, cilt.259, ss.443-451, 2014 (SCI İndekslerine Giren Dergi) identifier identifier

  • Cilt numarası: 259
  • Basım Tarihi: 2014
  • Doi Numarası: 10.1016/j.cam.2013.10.021
  • Dergi Adı: JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS
  • Sayfa Sayıları: ss.443-451

Özet

The generalized class of stochastic hybrid systems consists of models with regime changes including the occurrence of impulsive behavior. In this paper, the stochastic hybrid processes with jumps are approximated by locally consistent Markov decision processes that preserve local mean and covariance. We further apply a randomized switching policy for approximating the dynamics on the switching boundaries. To investigate the validity of the approximation, we study a stochastic optimal control problem. On the basis of the discrete approximation, we solve the optimal control problem and show that the solution obtained from the discretized problem converges to the solution of the original optimal control problem. (C) 2013 Elsevier B.V. All rights reserved.