The Annals of Applied Probability

Steady-state simulation of reflected Brownian motion and related stochastic networks

Jose Blanchet and Xinyun Chen

Full-text: Open access

Enhanced PDF (384 KB)

Abstract

This paper develops the first class of algorithms that enable unbiased estimation of steady-state expectations for multidimensional reflected Brownian motion. In order to explain our ideas, we first consider the case of compound Poisson (possibly Markov modulated) input. In this case, we analyze the complexity of our procedure as the dimension of the network increases and show that, under certain assumptions, the algorithm has polynomial-expected termination time. Our methodology includes procedures that are of interest beyond steady-state simulation and reflected processes. For instance, we use wavelets to construct a piecewise linear function that can be guaranteed to be within $\varepsilon$ distance (deterministic) in the uniform norm to Brownian motion in any compact time interval.

Article information

Source
Ann. Appl. Probab., Volume 25, Number 6 (2015), 3209-3250.

Dates
Received: January 2012
Revised: September 2014
First available in Project Euclid: 1 October 2015

Permanent link to this document
https://projecteuclid.org/euclid.aoap/1443703773

Digital Object Identifier
doi:10.1214/14-AAP1072

Mathematical Reviews number (MathSciNet)
MR3404635

Zentralblatt MATH identifier
1332.60120

Subjects
Primary: 60J65: Brownian motion [See also 58J65] 65C05: Monte Carlo methods

Keywords
Reflected Brownian motion steady-state simulation dominated coupling from the past wavelet representation

Citation

Blanchet, Jose; Chen, Xinyun. Steady-state simulation of reflected Brownian motion and related stochastic networks. Ann. Appl. Probab. 25 (2015), no. 6, 3209--3250. doi:10.1214/14-AAP1072. https://projecteuclid.org/euclid.aoap/1443703773


Export citation

References

  • Asmussen, S. (2003). Applied Probability and Queues: Stochastic Modelling and Applied Probability, 2nd ed. Applications of Mathematics (New York) 51. Springer, New York.
    Mathematical Reviews (MathSciNet): MR1978607
  • Asmussen, S. and Glynn, P. W. (2007). Stochastic Simulation: Algorithms and Analysis. Stochastic Modelling and Applied Probability 57. Springer, New York.
    Mathematical Reviews (MathSciNet): MR2331321
    Zentralblatt MATH: 1126.65001
  • Asmussen, S., Glynn, P. and Pitman, J. (1995). Discretization error in simulation of one-dimensional reflecting Brownian motion. Ann. Appl. Probab. 5 875–896.
    Mathematical Reviews (MathSciNet): MR1384357
    Zentralblatt MATH: 0853.65147
    Digital Object Identifier: doi:10.1214/aoap/1177004597
    Project Euclid: euclid.aoap/1177004597
  • Beskos, A., Peluchetti, S. and Roberts, G. (2012). $\varepsilon$-strong simulation of the Brownian path. Bernoulli 18 1223–1248.
    Mathematical Reviews (MathSciNet): MR2995793
    Digital Object Identifier: doi:10.3150/11-BEJ383
    Project Euclid: euclid.bj/1352727808
  • Billingsley, P. (1999). Convergence of Probability Measures, 2nd ed. Wiley, New York.
    Mathematical Reviews (MathSciNet): MR1700749
  • Blanchet, J. H. and Sigman, K. (2011). On exact sampling of stochastic perpetuities. J. Appl. Probab. 48A 165–182.
    Mathematical Reviews (MathSciNet): MR2865624
    Zentralblatt MATH: 1230.65012
    Digital Object Identifier: doi:10.1239/jap/1318940463
    Project Euclid: euclid.jap/1318940463
  • Budhiraja, A. and Lee, C. (2009). Stationary distribution convergence for generalized Jackson networks in heavy traffic. Math. Oper. Res. 34 45–56.
    Mathematical Reviews (MathSciNet): MR2542988
    Zentralblatt MATH: 1214.60013
    Digital Object Identifier: doi:10.1287/moor.1080.0353
  • Burdzy, K. and Chen, Z.-Q. (2008). Discrete approximations to reflected Brownian motion. Ann. Probab. 36 698–727.
    Mathematical Reviews (MathSciNet): MR2393994
    Zentralblatt MATH: 1141.60014
    Digital Object Identifier: doi:10.1214/009117907000000240
    Project Euclid: euclid.aop/1204306964
  • Burkholder, D. L. (1977). Exit times of Brownian motion, harmonic majorization, and Hardy spaces. Adv. Math. 26 182–205.
    Mathematical Reviews (MathSciNet): MR474525
    Zentralblatt MATH: 0372.60112
    Digital Object Identifier: doi:10.1016/0001-8708(77)90029-9
  • Dai, J. G. and Dieker, A. B. (2011). Nonnegativity of solutions to the basic adjoint relationship for some diffusion processes. Queueing Syst. 68 295–303.
    Mathematical Reviews (MathSciNet): MR2834200
    Digital Object Identifier: doi:10.1007/s11134-011-9236-z
  • Dai, J. G. and Harrison, J. M. (1992). Reflected Brownian motion in an orthant: Numerical methods for steady-state analysis. Ann. Appl. Probab. 2 65–86.
    Mathematical Reviews (MathSciNet): MR1143393
    Zentralblatt MATH: 0786.60107
    Digital Object Identifier: doi:10.1214/aoap/1177005771
    Project Euclid: euclid.aoap/1177005771
  • DeBlassie, R. D. (1987). Exit times from cones in ${\mathbf{R}}^{n}$ of Brownian motion. Probab. Theory Related Fields 74 1–29.
    Mathematical Reviews (MathSciNet): MR863716
    Zentralblatt MATH: 0586.60077
    Digital Object Identifier: doi:10.1007/BF01845637
  • Devroye, L. (2009). On exact simulation algorithms for some distributions related to Jacobi theta functions. Statist. Probab. Lett. 79 2251–2259.
    Mathematical Reviews (MathSciNet): MR2591982
  • Debicki, K., Dieker, A. B. and Rolski, T. (2007). Quasi-product forms for Lévy-driven fluid networks. Math. Oper. Res. 32 629–647.
    Mathematical Reviews (MathSciNet): MR2348239
    Digital Object Identifier: doi:10.1287/moor.1070.0259
  • Ensor, K. B. and Glynn, P. W. (2000). Simulating the maximum of a random walk. J. Statist. Plann. Inference 85 127–135.
    Mathematical Reviews (MathSciNet): MR1759244
    Zentralblatt MATH: 0974.60030
    Digital Object Identifier: doi:10.1016/S0378-3758(99)00075-0
  • Gamarnik, D. and Zeevi, A. (2006). Validity of heavy traffic steady-state approximation in generalized Jackson networks. Ann. Appl. Probab. 16 56–90.
    Mathematical Reviews (MathSciNet): MR2209336
    Digital Object Identifier: doi:10.1214/105051605000000638
    Project Euclid: euclid.aoap/1141654281
  • Gut, A. (2009). Stopped Random Walks: Limit Theorems and Applications, 2nd ed. Springer, New York.
    Mathematical Reviews (MathSciNet): MR2489436
  • Harrison, J. M. and Reiman, M. I. (1981). Reflected Brownian motion on an orthant. Ann. Probab. 9 302–308.
    Mathematical Reviews (MathSciNet): MR606992
    Zentralblatt MATH: 0462.60073
    Digital Object Identifier: doi:10.1214/aop/1176994471
    Project Euclid: euclid.aop/1176994471
  • Harrison, J. M. and Williams, R. J. (1987). Brownian models of open queueing networks with homogeneous customer populations. Stochastics 22 77–115.
    Mathematical Reviews (MathSciNet): MR912049
    Zentralblatt MATH: 0632.60095
    Digital Object Identifier: doi:10.1080/17442508708833469
  • Kella, O. (1996). Stability and nonproduct form of stochastic fluid networks with Lévy inputs. Ann. Appl. Probab. 6 186–199.
    Mathematical Reviews (MathSciNet): MR1389836
    Digital Object Identifier: doi:10.1214/aoap/1034968070
    Project Euclid: euclid.aoap/1034968070
  • Kella, O. and Ramasubramanian, S. (2012). Asymptotic irrelevance of initial conditions for Skorohod reflection mapping on the nonnegative orthant. Math. Oper. Res. 37 301–312.
    Mathematical Reviews (MathSciNet): MR2931282
    Zentralblatt MATH: 1248.90029
    Digital Object Identifier: doi:10.1287/moor.1120.0538
  • Kella, O. and Whitt, W. (1996). Stability and structural properties of stochastic storage networks. J. Appl. Probab. 33 1169–1180.
    Mathematical Reviews (MathSciNet): MR1416235
    Zentralblatt MATH: 0867.60081
    Digital Object Identifier: doi:10.2307/3214994
  • Kendall, W. S. (2004). Geometric ergodicity and perfect simulation. Electron. Commun. Probab. 9 140–151 (electronic).
    Mathematical Reviews (MathSciNet): MR2108860
    Zentralblatt MATH: 1061.60070
    Digital Object Identifier: doi:10.1214/ECP.v9-1117
  • Propp, J. G. and Wilson, D. B. (1996). Exact sampling with coupled Markov chains and applications to statistical mechanics. Random Structures Algorithms 9 223–252.
    Mathematical Reviews (MathSciNet): MR1611693
  • Ramasubramanian, S. (2000). A subsidy-surplus model and the Skorokhod problem in an orthant. Math. Oper. Res. 25 509–538.
    Mathematical Reviews (MathSciNet): MR1855180
    Zentralblatt MATH: 1073.91610
    Digital Object Identifier: doi:10.1287/moor.25.3.509.12215
  • Reiman, M. I. (1984). Open queueing networks in heavy traffic. Math. Oper. Res. 9 441–458.
    Mathematical Reviews (MathSciNet): MR757317
    Zentralblatt MATH: 0549.90043
    Digital Object Identifier: doi:10.1287/moor.9.3.441
  • Steele, J. M. (2001). Stochastic Calculus and Financial Applications. Applications of Mathematics (New York) 45. Springer, New York.
    Mathematical Reviews (MathSciNet): MR1783083
    Zentralblatt MATH: 0962.60001
  • Varadhan, S. R. S. and Williams, R. J. (1985). Brownian motion in a wedge with oblique reflection. Comm. Pure Appl. Math. 38 405–443.
    Mathematical Reviews (MathSciNet): MR792398
    Zentralblatt MATH: 0579.60082
    Digital Object Identifier: doi:10.1002/cpa.3160380405

The Institute of Mathematical Statistics

The Annals of Applied Probability

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more