Recursive Maximum Likelihood Identification of Jump Markov Nonlinear Systems

Creative Commons License

ÖZKAN E., Lindsten F., Fritsche C., Gustafsson F.

IEEE TRANSACTIONS ON SIGNAL PROCESSING, vol.63, no.3, pp.754-765, 2015 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 63 Issue: 3
  • Publication Date: 2015
  • Doi Number: 10.1109/tsp.2014.2385039
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.754-765
  • Keywords: Adaptive filtering, expectation maximization, identification, jump Markov systems, parameter estimation, particle filter, Rao-Blackwellization, transition probability estimation, MULTIPLE MODEL ALGORITHM, TRANSITION-PROBABILITIES, PARTICLE FILTER, TARGET TRACKING, EM, SIMULATION
  • Middle East Technical University Affiliated: Yes


We present an online method for joint state and parameter estimation in jump Markov non-linear systems (JMNLS). State inference is enabled via the use of particle filters which makes the method applicable to a wide range of non-linear models. To exploit the inherent structure of JMNLS, we design a Rao-Blackwellized particle filter (RBPF) where the discrete mode is marginalized out analytically. This results in an efficient implementation of the algorithm and reduces the estimation error variance. The proposed RBPF is then used to compute, recursively in time, smoothed estimates of complete data sufficient statistics. Together with the online expectation maximization algorithm, this enables recursive identification of unknown model parameters including the transition probability matrix. The method is also applicable to online identification of jump Markov linear systems(JMLS). The performance of the method is illustrated in simulations and on a localization problem in wireless networks using real data.