The Annals of Applied Probability

Commuting birth-and-death processes

Steven N. Evans, Bernd Sturmfels, and Caroline Uhler
Source: Ann. Appl. Probab. Volume 20, Number 1 (2010), 238-266.

Abstract

We use methods from combinatorics and algebraic statistics to study analogues of birth-and-death processes that have as their state space a finite subset of the m-dimensional lattice and for which the m matrices that record the transition probabilities in each of the lattice directions commute pairwise. One reason such processes are of interest is that the transition matrix is straightforward to diagonalize, and hence it is easy to compute n step transition probabilities. The set of commuting birth-and-death processes decomposes as a union of toric varieties, with the main component being the closure of all processes whose nearest neighbor transition probabilities are positive. We exhibit an explicit monomial parametrization for this main component, and we explore the boundary components using primary decomposition.

First Page: Show Hide
Primary Subjects: 60J22, 60C05, 13P10, 68W30
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1262962323
Digital Object Identifier: doi:10.1214/09-AAP615
Zentralblatt MATH identifier: 05678704
Mathematical Reviews number (MathSciNet): MR2582648

References

[1] Buffington, J. and Elliott, R. J. (2002). American options with regime switching. Int. J. Theor. Appl. Finance 5 497–514.
Mathematical Reviews (MathSciNet): MR1916958
Zentralblatt MATH: 1107.91325
Digital Object Identifier: doi:10.1142/S0219024902001523
[2] Craciun, G., Dickenstein, A., Shiu, A. and Sturmfels, B. (2009). Toric dynamical systems. J. Symbolic Comput. 44 1551–1565.
Mathematical Reviews (MathSciNet): MR2561288
Zentralblatt MATH: 05611765
Digital Object Identifier: doi:10.1016/j.jsc.2008.08.006
[3] Diaconis, P., Eisenbud, D. and Sturmfels, B. (1998). Lattice walks and primary decomposition. In Mathematical Essays in Honor of Gian–Carlo Rota (Cambridge, MA, 1996) (B. Sagan and R. Stanley, eds.). Progress in Mathematics 161 173–193. Birkhäuser Boston, Boston, MA.
Mathematical Reviews (MathSciNet): MR1627343
Zentralblatt MATH: 0962.05010
[4] Di Mazi, G. B., Kabanov, Y. M. and Runggal’der, V. I. (1994). Mean-square hedging of options on a stock with Markov volatilities. Teor. Veroyatnost. i Primenen. 39 211–222.
Mathematical Reviews (MathSciNet): MR1348196
[5] Drton, M., Sturmfels, B. and Sullivant, S. (2009). Lectures on Algebraic Statistics. Oberwolfach Seminar Series 39. Birkhäuser, Basel.
[6] Eisenbud, D. and Sturmfels, B. (1996). Binomial ideals. Duke Math. J. 84 1–45.
Mathematical Reviews (MathSciNet): MR1394747
Zentralblatt MATH: 0873.13021
Digital Object Identifier: doi:10.1215/S0012-7094-96-08401-X
Project Euclid: euclid.dmj/1077243627
[7] Ephraim, Y. and Merhav, N. (2002). Hidden Markov processes. IEEE Trans. Inform. Theory 48 1518–1569.
Mathematical Reviews (MathSciNet): MR1909472
Digital Object Identifier: doi:10.1109/TIT.2002.1003838
[8] Gilmer, R. (1984). Commutative Semigroup Rings. Univ. Chicago Press, Chicago, IL.
Mathematical Reviews (MathSciNet): MR741678
[9] Godsil, C. and Royle, G. (2001). Algebraic Graph Theory. Graduate Texts in Mathematics 207. Springer, New York.
Mathematical Reviews (MathSciNet): MR1829620
Zentralblatt MATH: 0968.05002
[10] Grünbaum, F. A. (2008). Random walks and orthogonal polynomials: Some challenges. In Probability, Geometry and Integrable Systems. Mathematical Sciences Research Institute Publications 55 241–260. Cambridge Univ. Press, Cambridge.
[11] Holst, U., Lindgren, G., Holst, J. and Thuvesholmen, M. (1994). Recursive estimation in switching autoregressions with a Markov regime. J. Time Ser. Anal. 15 489–506.
Mathematical Reviews (MathSciNet): MR1292163
Zentralblatt MATH: 0807.62061
Digital Object Identifier: doi:10.1111/j.1467-9892.1994.tb00206.x
[12] Horn, R. A. and Johnson, C. R. (1990). Matrix Analysis. Cambridge Univ. Press, Cambridge.
Mathematical Reviews (MathSciNet): MR1084815
[13] Karlin, S. and McGregor, J. (1955). Representation of a class of stochastic processes. Proc. Natl. Acad. Sci. USA 41 387–391.
Mathematical Reviews (MathSciNet): MR71665
Zentralblatt MATH: 0067.10803
Digital Object Identifier: doi:10.1073/pnas.41.6.387
[14] Karlin, S. and McGregor, J. (1959). Random walks. Illinois J. Math. 3 66–81.
Mathematical Reviews (MathSciNet): MR100927
Zentralblatt MATH: 0104.11804
Project Euclid: euclid.ijm/1255454999
[15] Latouche, G. and Ramaswami, V. (1999). Introduction to Matrix Analytic Methods in Stochastic Modeling. SIAM, Philadelphia, PA.
Mathematical Reviews (MathSciNet): MR1674122
Zentralblatt MATH: 0922.60001
[16] Neuts, M. F. (1994). Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Dover, New York.
Mathematical Reviews (MathSciNet): MR1313503
Zentralblatt MATH: 0469.60002
[17] Ng, A. C. Y. and Yang, H. (2006). On the joint distribution of surplus before and after ruin under a Markovian regime switching model. Stochastic Process. Appl. 116 244–266.
Mathematical Reviews (MathSciNet): MR2197976
Zentralblatt MATH: 1093.60051
Digital Object Identifier: doi:10.1016/j.spa.2005.09.008
[18] Oxley, J. G. (1992). Matroid Theory. Oxford Univ. Press, Oxford.
Mathematical Reviews (MathSciNet): MR1207587
[19] Stolyar, A. L. (2003). Scheduling of a generalized switch: Heavy traffic regime. In Telecommunications Network Design and Management (Boca Raton, FL, 2002). Operations Research/Computer Science Interfaces Series 23 143–165. Kluwer, Boston, MA.
Mathematical Reviews (MathSciNet): MR1974815
[20] Sturmfels, B. (1995). Gröbner Bases and Convex Polytopes. University Lecture Series 8. Amer. Math. Soc., Providence, RI.
[21] Yin, G., Krishnamurthy, V. and Ion, C. (2004). Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization. SIAM J. Optim. 14 1187–1215.
Mathematical Reviews (MathSciNet): MR2112970
Zentralblatt MATH: 1112.62330
Digital Object Identifier: doi:10.1137/S1052623403423709
[22] Zhou, X. Y. and Yin, G. (2003). Markowitz’s mean-variance portfolio selection with regime switching: A continuous-time model. SIAM J. Control Optim. 42 1466–1482.
Mathematical Reviews (MathSciNet): MR2044805
Zentralblatt MATH: 1175.91169
Digital Object Identifier: doi:10.1137/S0363012902405583

2012 © Institute of Mathematical Statistics

The Annals of Applied Probability

The Annals of Applied Probability