- Stoch. Syst.
- Volume 7, Number 2 (2017), 289-314.
Detecting Markov Chain Instability: A Monte Carlo Approach
We devise a Monte Carlo based method for detecting whether a non-negative Markov chain is stable for a given set of parameter values. More precisely, for a given subset of the parameter space, we develop an algorithm that is capable of deciding whether the set has a subset of positive Lebesgue measure for which the Markov chain is unstable. The approach is based on a variant of simulated annealing, and consequently only mild assumptions are needed to obtain performance guarantees.
The theoretical underpinnings of our algorithm are based on a result stating that the stability of a set of parameters can be phrased in terms of the stability of a single Markov chain that searches the set for unstable parameters. Our framework leads to a procedure that is capable of performing statistically rigorous tests for instability, which has been extensively tested using several examples of standard and non-standard queueing networks.
Stoch. Syst., Volume 7, Number 2 (2017), 289-314.
Received: September 2016
Accepted: July 2017
First available in Project Euclid: 24 February 2018
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 60K25: Queueing theory [See also 68M20, 90B22] 90B22: Queues and service [See also 60K25, 68M20] 68W40: Analysis of algorithms [See also 68Q25] 68M20: Performance evaluation; queueing; scheduling [See also 60K25, 90Bxx]
Mandjes, M.; Patch, B.; Walton, N. S. Detecting Markov Chain Instability: A Monte Carlo Approach. Stoch. Syst. 7 (2017), no. 2, 289--314. doi:10.1287/stsy.2017.0003. https://projecteuclid.org/euclid.ssy/1519441215