Open Access
January 1999 Compound Poisson Approximation for Markov Chains using Stein’s Method
Torkel Erhardsson
Ann. Probab. 27(1): 565-596 (January 1999). DOI: 10.1214/aop/1022677272

Abstract

Let $\eta$ be a stationary Harris recurrent Markov chain on a Polish state space $(S, \mathscr{F})$, with stationary distribution $\mu$. Let $\Psi_n:=\sum_{i-1}^n I\{\mu\in S_1\}$ be the number of visits to $S_1\in\mathscr{F}$ by $\eta$, where $S_1$ is “rare” in the sense that $\mu(S_1)$ is “small.” We want to find an approximating compound Poisson distribution for$ \mathscr{L}(\Psi_n)$, such that the approximation error, measured using the total variation distance, can be explicitly bounded with a bound of order not much larger than $\mu(S_1)$. This is motivated by the observation that approximating Poisson distributions often give larger approximation errors when the visits to $S_1$ by $\eta$ tend to occur in clumps and also by the compound Poisson limit theorems of classical extreme value theory.

We here propose an approximating compound Poisson distribution which in a natural way takes into account the regenerative properties of Harris recurrent Markov chains. A total variation distance error bound for this approximation is derived, using the compound Poisson Stein equation of Barbour, Chen and Loh and certain couplings. When the chain has an atom $S_0$ (e.g., a singleton) such that $\mu(S_0)>0$, the bound depends only on much studied quantities like hitting probabilities and expected hitting times, which satisfy Poisson’s equation. As “by-products” we also get upper and lower bounds for the error in the approximation with Poisson or normal distributions. The above results are illustrated by numerical evaluations of the error bound for some Markov chains on finite state spaces.

Citation

Download Citation

Torkel Erhardsson. "Compound Poisson Approximation for Markov Chains using Stein’s Method." Ann. Probab. 27 (1) 565 - 596, January 1999. https://doi.org/10.1214/aop/1022677272

Information

Published: January 1999
First available in Project Euclid: 29 May 2002

zbMATH: 0942.60007
MathSciNet: MR1681149
Digital Object Identifier: 10.1214/aop/1022677272

Subjects:
Primary: 60E15 , 60J05
Secondary: 60G70

Keywords: “rare” set , approximation , Compound Poisson , coupling , error bound , expected hitting times , Harris recurrence , hitting probabilities , regenerative , stationary Markov chain , Stein equation

Rights: Copyright © 1999 Institute of Mathematical Statistics

Vol.27 • No. 1 • January 1999
Back to Top