Importance sampling for a Markov modulated queuing network

SEZER A. D.

STOCHASTIC PROCESSES AND THEIR APPLICATIONS, vol.119, no.2, pp.491-517, 2009 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 119 Issue: 2
  • Publication Date: 2009
  • Doi Number: 10.1016/j.spa.2008.02.009
  • Journal Name: STOCHASTIC PROCESSES AND THEIR APPLICATIONS
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.491-517
  • Keywords: Dynamic importance sampling, Rare event simulation, Tandem queues, Queuing networks, Markov modulated, Regime switch, Overflow probability, Large deviations, Isaacs equation, Optimal control, LARGE DEVIATIONS, UPPER-BOUNDS
  • Middle East Technical University Affiliated: Yes

Abstract

Importance sampling (IS) is a variance reduction method for simulating rare events. A recent paper by Dupuis, Wang and Sezer [Paul Dupuis, Ali Devin Sezer, Hui Wang, Dynamic importance sampling for queueing networks, Annals of Applied Probability 17 (4) (2007) 1306-1346] exploits connections between IS and stochastic games and optimal control problems to show how to design and analyze simple and efficient IS algorithms for various overflow events of tandem Jackson Networks. The present paper carries out a program parallel to the paper by Dupuis et al. for a two node tandem network whose arrival and service rates are modulated by in exogenous finite state Markov process. The overflow event we study is the following: the number of customers in the system reaches n without the system ever becoming empty, given that initially the system is empty. (C) 2008 Elsevier B.V. All rights reserved.