On the uniform ergodicity of Markov processes of order 2



Journal of Applied Probability

On the uniform ergodicity of Markov processes of order 2

Ulrich Herkenrath

Source: J. Appl. Probab. Volume 40, Number 2 (2003), 455-472.

Abstract

We study the uniform ergodicity of Markov processes (Zn, n ≥ 1) of order 2 with a general state space (Z, Z). Markov processes of order higher than 1 were defined in the literature long ago, but scarcely treated in detail. We take as the basis for our considerations the natural transition probability Q of such a process. A Markov process of order 2 is transformed into one of order 1 by combining two consecutive variables Z2n-1 and Z2n into one variable Yn with values in the Cartesian product space (Z x Z, ZZ). Thus, a Markov process (Yn, n ≥ 1) of order 1 with transition probability R is generated. Uniform ergodicity for the process (Zn, n ≥ 1) is defined in terms of the same property for (Yn, n ≥ 1). We give some conditions on the transition probability Q which transfer to R and thus ensure the uniform ergodicity of (Zn, n ≥ 1). We apply the general results to study the uniform ergodicity of Markov processes of order 2 which arise in some nonlinear time series models and as sequences of smoothed values in sequential smoothing procedures of Markovian observations. As for the time series models, Markovian noise sequences are covered.

Primary Subjects: 60J05
Secondary Subjects: 60J20
Keywords: Markov process of order 2; uniform ergodicity; nonlinear time series; exponential smoothing; Markovian noise sequence; Markovian innovations

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Alternatively, the document is available for a cost of $6. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.jap/1053003556
Digital Object Identifier: doi:10.1239/jap/1053003556
Mathematical Reviews number (MathSciNet): MR1978103
Zentralblatt MATH identifier: 1031.60065

References

Billingsley, P. (1968). Convergence of Probability Measures. John Wiley, New York.
Mathematical Reviews (MathSciNet): MR233396
Borkovec, M. and Klüppelberg, C. (2001). The tail of the stationary distribution of an autoregressive process with ARCH(1)-errors. Ann. Appl. Prob. 11, 1220--1241.
Mathematical Reviews (MathSciNet): MR1878296
Digital Object Identifier: doi:10.1214/aoap/1015345401
Bowerman, B. L. and O'Connell, R. T. (1993). Forecasting and Time Series: An Applied Approach. Duxbury, Belmont, CA.
Mathematical Reviews (MathSciNet): MR635926
Brown, R. G. (1963). Smoothing, Forecasting and Prediction of Discrete Time Series. Prentice-Hall, Englewood Cliffs, NJ.
Doob, J. L. (1953). Stochastic Processes. John Wiley, New York.
Mathematical Reviews (MathSciNet): MR58896
Herkenrath, U. (1977). Markov processes under continuity assumptions. Rev. Roumaine Math. Pures Appl. 22, 1419--1431.
Mathematical Reviews (MathSciNet): MR467920
Herkenrath, U. (1994a). Generalized adaptive exponential smoothing procedures. J. Appl. Prob. 31, 673--690.
Mathematical Reviews (MathSciNet): MR1285507
Herkenrath, U. (1994b). Premium adjustment by generalized adaptive exponential smoothing. Insurance Math. Econom. 15, 203--217.
Mathematical Reviews (MathSciNet): MR1333089
Digital Object Identifier: doi:10.1016/0167-6687(94)90795-1
Herkenrath, U. (1999). Generalized adaptive exponential smoothing of observations from an ergodic hidden Markov model. J. Appl. Prob. 36, 987--998.
Mathematical Reviews (MathSciNet): MR1742144
Iosifescu, M. and Grigorescu, S. (1990). Dependence with Complete Connections and Its Applications. Cambridge University Press.
Mathematical Reviews (MathSciNet): MR1070097
Iosifescu, M. and Theodorescu, R. (1969). Random Processes and Learning. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR293704
Meyn, S. P. and Tweedie, R. L. (1996). Markov Chains and Stochastic Stability. Springer, London.
Mathematical Reviews (MathSciNet): MR1287609
Royden, H. L. (1968). Real Analysis, 2nd edn. Macmillan, New York.
Mathematical Reviews (MathSciNet): MR151555
Tong, H. (1995). Non-Linear Time Series. Oxford University Press.
Mathematical Reviews (MathSciNet): MR1079320
Weiss, A. A. (1984). ARMA models with ARCH errors. J. Time Ser. Anal. 5, 129--143.
Zentralblatt MATH: 0549.62079

2008 © Applied Probability Trust