Source: Ann. Appl. Probab. Volume 20, Number 1
(2010), 238-266.
We use methods from combinatorics and algebraic statistics to study analogues of birth-and-death processes that have as their state space a finite subset of the m-dimensional lattice and for which the m matrices that record the transition probabilities in each of the lattice directions commute pairwise. One reason such processes are of interest is that the transition matrix is straightforward to diagonalize, and hence it is easy to compute n step transition probabilities. The set of commuting birth-and-death processes decomposes as a union of toric varieties, with the main component being the closure of all processes whose nearest neighbor transition probabilities are positive. We exhibit an explicit monomial parametrization for this main component, and we explore the boundary components using primary decomposition.
References
[1] Buffington, J. and Elliott, R. J. (2002). American options with regime switching. Int. J. Theor. Appl. Finance 5 497–514.
[2] Craciun, G., Dickenstein, A., Shiu, A. and Sturmfels, B. (2009). Toric dynamical systems. J. Symbolic Comput. 44 1551–1565.
[3] Diaconis, P., Eisenbud, D. and Sturmfels, B. (1998). Lattice walks and primary decomposition. In Mathematical Essays in Honor of Gian–Carlo Rota (Cambridge, MA, 1996) (B. Sagan and R. Stanley, eds.). Progress in Mathematics 161 173–193. Birkhäuser Boston, Boston, MA.
[4] Di Mazi, G. B., Kabanov, Y. M. and Runggal’der, V. I. (1994). Mean-square hedging of options on a stock with Markov volatilities. Teor. Veroyatnost. i Primenen. 39 211–222.
[5] Drton, M., Sturmfels, B. and Sullivant, S. (2009). Lectures on Algebraic Statistics. Oberwolfach Seminar Series 39. Birkhäuser, Basel.
[6] Eisenbud, D. and Sturmfels, B. (1996). Binomial ideals. Duke Math. J. 84 1–45.
[7] Ephraim, Y. and Merhav, N. (2002). Hidden Markov processes. IEEE Trans. Inform. Theory 48 1518–1569.
[8] Gilmer, R. (1984). Commutative Semigroup Rings. Univ. Chicago Press, Chicago, IL.
Mathematical Reviews (MathSciNet):
MR741678
[9] Godsil, C. and Royle, G. (2001). Algebraic Graph Theory. Graduate Texts in Mathematics 207. Springer, New York.
[10] Grünbaum, F. A. (2008). Random walks and orthogonal polynomials: Some challenges. In Probability, Geometry and Integrable Systems. Mathematical Sciences Research Institute Publications 55 241–260. Cambridge Univ. Press, Cambridge.
[11] Holst, U., Lindgren, G., Holst, J. and Thuvesholmen, M. (1994). Recursive estimation in switching autoregressions with a Markov regime. J. Time Ser. Anal. 15 489–506.
[12] Horn, R. A. and Johnson, C. R. (1990). Matrix Analysis. Cambridge Univ. Press, Cambridge.
[13] Karlin, S. and McGregor, J. (1955). Representation of a class of stochastic processes. Proc. Natl. Acad. Sci. USA 41 387–391.
Mathematical Reviews (MathSciNet):
MR71665
[14] Karlin, S. and McGregor, J. (1959). Random walks. Illinois J. Math. 3 66–81.
Mathematical Reviews (MathSciNet):
MR100927
[15] Latouche, G. and Ramaswami, V. (1999). Introduction to Matrix Analytic Methods in Stochastic Modeling. SIAM, Philadelphia, PA.
[16] Neuts, M. F. (1994). Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Dover, New York.
[17] Ng, A. C. Y. and Yang, H. (2006). On the joint distribution of surplus before and after ruin under a Markovian regime switching model. Stochastic Process. Appl. 116 244–266.
[18] Oxley, J. G. (1992). Matroid Theory. Oxford Univ. Press, Oxford.
[19] Stolyar, A. L. (2003). Scheduling of a generalized switch: Heavy traffic regime. In Telecommunications Network Design and Management (Boca Raton, FL, 2002). Operations Research/Computer Science Interfaces Series 23 143–165. Kluwer, Boston, MA.
[20] Sturmfels, B. (1995). Gröbner Bases and Convex Polytopes. University Lecture Series 8. Amer. Math. Soc., Providence, RI.
[21] Yin, G., Krishnamurthy, V. and Ion, C. (2004). Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization. SIAM J. Optim. 14 1187–1215.
[22] Zhou, X. Y. and Yin, G. (2003). Markowitz’s mean-variance portfolio selection with regime switching: A continuous-time model. SIAM J. Control Optim. 42 1466–1482.