Dynamic programming for a Markov-switching jump-diffusion

Azevedo N., Pinheiro D., WEBER G. W.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, cilt.267, ss.1-19, 2014 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 267
  • Basım Tarihi: 2014
  • Doi Numarası: 10.1016/j.cam.2014.01.021
  • Dergi Adı: JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.1-19
  • Anahtar Kelimeler: Stochastic optimal control, Jump-diffusion, Markov-switching, Optimal consumption-investment, NEURAL-NETWORK, PORTFOLIO, MODELS, SYSTEM
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

We consider an optimal control problem with a deterministic finite horizon and state variable dynamics given by a Markov-switching jump-diffusion stochastic differential equation. Our main results extend the dynamic programming technique to this larger family of stochastic optimal control problems. More specifically, we provide a detailed proof of Bellman's optimality principle (or dynamic programming principle) and obtain the corresponding Hamilton-Jacobi-Belman equation, which turns out to be a partial integro-differential equation due to the extra terms arising from the Levy process and the Markov process. As an application of our results, we study a finite horizon consumption-investment problem for a jump-diffusion financial market consisting of one risk-free asset and one risky asset whose coefficients are assumed to depend on the state of a continuous time finite state Markov process. We provide a detailed study of the optimal strategies for this problem, for the economically relevant families of power utilities and logarithmic utilities. (C) 2014 Elsevier B.V. All rights reserved.