The Annals of Probability
previous :: next

On Positive Recurrence of Constrained Diffusion Processes

Rami Atar, Amarjit Budhiraja, and Paul Dupuis
Source: Ann. Probab. Volume 29, Number 2 (2001), 979-1000.

Abstract

Let $G \subset \mathbb{R}^k$ be a convex polyhedral cone with vertex at the origin given as the intersection of half spaces $\{G_i, i =1,\ldots, N\}$, where $n_i$ and $d_i$ denote the inward normal and direction of constraint associated with $G_i$, respectively. Stability properties of a class of diffusion processes, constrained to take values in $G$, are studied under the assumption that the Skorokhod problem defined by the data $\{(n_i,d_i),i = 1,\ldots,N\}$ is well posed and the Skorokhod map is Lipschitz continuous. Explicit conditions on the drift coefficient, $b(\cdot)$, of the diffusion process are given under which the constrained process is positive recurrent and has a unique invariant measure.Define

display for 14-aop29i2

Then the key condition for stability is that there exists $\delta \in (0,\infty)$ and a bounded subset $A$ of $G$ such that for all $x \in G\setminus A, b(x) \in \mathcal{C}$ and $\dist (b(x),\partial\mathcal{C}) \ge \delta$, where $\partial\mathcal{C}$denotes the boundary of $\mathcal{C}$.

First Page: Show Hide
Primary Subjects: 60J60
Secondary Subjects: 60J65, 60K25, 34D20
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aop/1008956699
Digital Object Identifier: doi:10.1214/aop/1008956699
Mathematical Reviews number (MathSciNet): MR1872747
Zentralblatt MATH identifier: 1018.60081

References

[1] Budhiraja, A. and Dupuis, P. (199). Simple necessary and sufficient conditions for the stability of constrained processes. SIAMJ. Appl. Math. 59 1686-1700.
Mathematical Reviews (MathSciNet): MR2000j:93106
Zentralblatt MATH: 0934.93068
Digital Object Identifier: doi:10.1137/S0036139997330222
[2] Chen, H. (1996). A sufficient condition for the positive recurrence of a semimartingale reflecting Brownian motion in an orthant. Ann. Appl. Probab. 6 758-765.
Zentralblatt MATH: 0860.60062
Mathematical Reviews (MathSciNet): MR1410114
Digital Object Identifier: doi:10.1214/aoap/1034968226
Project Euclid: euclid.aoap/1034968226
[3] Chen, H. and Mandelbaum, A. (1991). Discrete flow networks: Bottlenecks analysis and fluid approximations. Math. Operations Res. 16 408-446.
Mathematical Reviews (MathSciNet): MR1106809
Zentralblatt MATH: 0735.60095
Digital Object Identifier: doi:10.1287/moor.16.2.408
[4] Dai, J. G. (1995). Stability of open multiclass queueing networks via fluid models. In Stochastic Networks (F. P. Kelley and R. J. Williams, eds.) 71-90. Springer, New York.
Mathematical Reviews (MathSciNet): MR1381005
Zentralblatt MATH: 0823.60083
[5] Dai, J. G. (1996). A fluid-limit model criterion for instability of multiclass queueing networks. Ann. Appl. Probab. 6 751-757.
Zentralblatt MATH: 0860.60075
Mathematical Reviews (MathSciNet): MR1410113
Digital Object Identifier: doi:10.1214/aoap/1034968225
Project Euclid: euclid.aoap/1034968225
[6] Dupuis, P. and Ishii, H. (1991). On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applications. Stochastics 35 31-62.
Mathematical Reviews (MathSciNet): MR93e:60110
Zentralblatt MATH: 0721.60062
[7] Dupuis, P. and Ramanan, K. (1999). Convex duality and the Skorokhod Problem. I, II. Probab. Theory Related Fields 2 153-195; 197-236.
Mathematical Reviews (MathSciNet): MR2001f:49041
Digital Object Identifier: doi:10.1007/s004400050269
[8] Dupuis, P. and Ramanan, K. (1999). A multiclass feedback queueing network with a regular Skorokhod problem. LCDS Report 99-5.
Mathematical Reviews (MathSciNet): MR1823974
Digital Object Identifier: doi:10.1023/A:1011037419624
[9] Dupuis, P. and Williams, R. J. (1994). Lyapunov functions for semimartingale reflecting Brownian motions. Ann. Probab. 22 680-702.
Mathematical Reviews (MathSciNet): MR95k:60204
Zentralblatt MATH: 0808.60068
Digital Object Identifier: doi:10.1214/aop/1176988725
Project Euclid: euclid.aop/1176988725
[10] Anderson, R. F. and Orey, S. (1976). Small random perturbations of dynamical systems with reflecting boundary. Nagoya Math J. 60 189-216.
Mathematical Reviews (MathSciNet): MR397893
Zentralblatt MATH: 0324.60063
Project Euclid: euclid.nmj/1118795643
[11] Harrison, J. M. and Reiman, M. I. (1981). Reflected Brownian motion on an orthant. Ann. Probab. 9 302-308.
Mathematical Reviews (MathSciNet): MR82c:60141
Zentralblatt MATH: 0462.60073
Digital Object Identifier: doi:10.1214/aop/1176994471
Project Euclid: euclid.aop/1176994471
[12] Harrison, J. M. and Williams, R. J. (1987). Brownian models of open queueing networks with homogeneous customer populations. Stochastics 22 77-115.
Mathematical Reviews (MathSciNet): MR89b:60215
Zentralblatt MATH: 0632.60095
[13] Harrison, J. M. and Williams, R. J. (1987). Multidimensional reflected Brownian motions having exponential stationary distributions. Ann. Probab. 15 115-137.
Mathematical Reviews (MathSciNet): MR88e:60091
Zentralblatt MATH: 0615.60072
Digital Object Identifier: doi:10.1214/aop/1176992259
Project Euclid: euclid.aop/1176992259
[14] Hobson, D. G. and Rogers, L. C. G. (1993). Recurrence and transience of reflecting Brownian motion in the quadrant. Math. Proc. Cambridge Philos. Soc. 113 387-399.
Mathematical Reviews (MathSciNet): MR93k:60207
Zentralblatt MATH: 0776.60100
Digital Object Identifier: doi:10.1017/S0305004100076040
[15] Malyshev, V. A. (1993). Networks and dyamical systems. Adv. in Appl. Probab. 25 140-175.
Mathematical Reviews (MathSciNet): MR1206537
Zentralblatt MATH: 0768.60075
Digital Object Identifier: doi:10.2307/1427500
[16] Meyn, S. P. (1995). Transience of multiclass queueing networks via fluid limit models. Ann. Appl. Probab. 5 946-957.
Mathematical Reviews (MathSciNet): MR97f:60193
Zentralblatt MATH: 0865.60079
Digital Object Identifier: doi:10.1214/aoap/1177004601
Project Euclid: euclid.aoap/1177004601
[17] Nguyen, V. (1993). Processing networks with parallel and sequential tasks: Heavy traffic analysis and Brownian limits. Ann. Appl. Probab. 3 28-55.
Mathematical Reviews (MathSciNet): MR94f:60121
Zentralblatt MATH: 0771.60082
Digital Object Identifier: doi:10.1214/aoap/1177005506
Project Euclid: euclid.aoap/1177005506
[18] Peterson, W. (1991). A heavy traffic limit theorem for networks of queues with multiple customer types. Math. Operations Res. 16 90-118.
Mathematical Reviews (MathSciNet): MR92d:60102
Zentralblatt MATH: 0727.60114
Digital Object Identifier: doi:10.1287/moor.16.1.90
[19] Reiman, M. I. (1984). Open queueing networks in heavy traffic. Math. Opererations Res. 9 441-458.
Mathematical Reviews (MathSciNet): MR86b:60158
Zentralblatt MATH: 0549.90043
Digital Object Identifier: doi:10.1287/moor.9.3.441
[20] Skorohod, A. V. (1987). Asymptotic Methods in the Theory of Stochastic Differential Equations. Amer. Math. Soc., Providence, RI.
[21] Williams, R. J. (1985). Recurrence classification and invariant measures for reflected Brownian motion in a wedge. Ann. Probab. 13 758-778.
Mathematical Reviews (MathSciNet): MR799421
Zentralblatt MATH: 0596.60078
Digital Object Identifier: doi:10.1214/aop/1176992907
Project Euclid: euclid.aop/1176992907
previous :: next

2012 © Institute of Mathematical Statistics

The Annals of Probability

The Annals of Probability