Source: Bernoulli Volume 8, Number 4
(2002), 451-473.
In this paper, we consider an asymptotic Bayesian analysis for Gaussian processes with
long memory. First, we determine the asymptotic expansion of the posterior density based
on a normal approximation. This expansion leads to the construction of Bayesian
confidence regions such as highest posterior density regions and to the determination of
matching prior. Then, we generalize Clarke and Barron's result in the long-memory
set-up. More precisely, we establish the asymptotic expansion of the Kullback-Leibler
distance between the true density and the marginal density of the observations. As in
the independent and identically distributed case, this result gives an asymptotic
justification of Berger and Bernardo's algorithm to obtain reference priors.
References
[1] Beran, J. (1994) Statistics for Long Memory Processes. London: Chapman & Hall.
[2] Berger, J.O. and Bernardo, J.M. (1989) Estimating a product of means - Bayesian analysis with reference priors. J. Amer. Statist. Assoc., 84, 200-207. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet):
MR999679
[3] Berger, J. and Bernardo, J. (1992a) Reference priors in a variance components problem. In P.K. Goel and N.S. Iyengar (eds), Bayesian Analysis in Statistics and Econometrics. New York: Springer- Verlag.
[4] Berger, J. and Bernardo, J. (1992b) On the development of the reference prior method. In J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith (eds), Bayesian Statistics 4, pp. 35-49. Oxford: Oxford University Press.
[5] Bernardo, J.M. (1979) Reference posterior distributions for Bayesian inference (with discussion). J. Roy. Statist. Soc. Ser. B, 41, 113-147.
Mathematical Reviews (MathSciNet):
MR547240
[6] Carlin, J., Dempster, A.P. and Jonas, A.B. (1985) On models and methods for Bayesian time series analysis. J. Econometrics, 30, 67-90. \n
Mathematical Reviews (MathSciNet):
MR835574
[7] Clarke, B. and Barron, A. (1990) Information-theoretic asymptotics of Bayes methods. IEEE Trans. Inform. Theory, 36, 453-471.
[8] Clarke, B. and Sun, D. (1997) Reference priors under the chi-squared distance. Sankhya Ser. A, 59, 215-231. Abstract can also be found in the ISI/STMA publication
[9] Dahlhaus R. (1989) Efficient parameter estimation for self-similar processes, Ann. Statist., 17, 1749-1766.
[10] Datta, G.S. (1996) On priors providing frequentist validity for Bayesian parametric functions. Biometrika, 83, 287-298. Abstract can also be found in the ISI/STMA publication
[11] Datta, G.S. and Ghosh, J.K. (1995) On priors providing frequentist validity for Bayesian inference. Biometrika, 82, 37-45. Abstract can also be found in the ISI/STMA publication
[12] Fox, R. and Taqqu, M.S. (1986) Large sample properties of parameter estimates for strongly dependent stationary Gaussian time series. Ann. Statist., 14, 517-532.
Mathematical Reviews (MathSciNet):
MR840512
[13] Geyer, C. (1999) Likelihood inference for spatial point processes. In Stochastic Geometry, Likelihood and Computation., O.E. Barndorff-Nielsen, W.S. Kendall and M.N.M. van Lieshout (Eds). London: Chapman & Hall.
[14] Ghosh, J.K. and Mukerjee, R. (1992) Non-informative prior. In J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith (eds), Bayesian Statistics 4, pp. 195-203. Oxford: Oxford University Press. Abstract can also be found in the ISI/STMA publication
[15] Ghosh, J.K. and Mukerjee, R. (1993) Frequentist validity of highest posterior density regions in the multiparameter case. Ann. Inst. Statist. Math., 45, 293-302. Abstract can also be found in the ISI/STMA publication
[16] Ghosh, M., Carlin, B.P. and Srivastava, M.S. (1995) Probability matching priors for linear calibration. T.E.S.T., 4, 333-358. Abstract can also be found in the ISI/STMA publication
[17] Giraitis, L. and Surgalis, D. (1990) A central limit theorem for quadratic forms in strongly dependent linear variables and its applications to asymptotic normality of Whittlés estimate. Probab. Theory Related Fields., 86, 87-104.
[18] Granger, C.W.J. and Joyeux, R. (1980) An introduction to long memory time series models and fractional differencing. J. Time Ser. Anal., 1, 15-29.
Mathematical Reviews (MathSciNet):
MR605572
[19] Hosking, J.R.M. (1981) Fractional differencing. Biometrika, 68, 165-176.
Mathematical Reviews (MathSciNet):
MR614953
[20] Johnson, R.A. (1970) Asymptotic expansions associated with posterior distributions. Ann. Math. Statist., 41, 851-864.
Mathematical Reviews (MathSciNet):
MR263198
[21] Koop, G., Ley, E., Osiewalski, J. and Steel, M.F.J. (1994) Posterior properties of long-run impulse responses. J. Business Econom. Statist., 12, 489-492. Abstract can also be found in the ISI/STMA publication
[22] Koop, G., Ley, E., Osiewalski, J. and Steel, M.F.J. (1997) Bayesian analysis of long memory and persistence using ARFIMA models. J. Econometrics, 76, 149-169. Abstract can also be found in the ISI/STMA publication
[23] Lieberman, O., Rousseau, J. and Zucker, D.M. (1999) Valid asymptotic expansions for the maximum likelihood estimator of the parameter of a stationary, Gaussian, strongly dependent process. Preprint.
[24] Mukerjee, R. and Dey, D.K. (1993) Frequentist validity of posterior quantiles in the presence of nuisance parameter: higher order asymptotics. Biometrika, 80, 499-505. Abstract can also be found in the ISI/STMA publication
[25] Osiewalski, J. and Steel, M.F.J. (1993) Bayesian marginal equivalence of elliptical regression models. J. Econometrics, 59, 391-403. Abstract can also be found in the ISI/STMA publication
[26] Pai, J.S. and Ravishanker, N. (1998) Bayesian analysis of autoregressive fractionally integrated moving-average processes. J. Time Ser. Anal., 19, 99-112. Abstract can also be found in the ISI/STMA publication
[27] Peers, H.W. (1965) On confidence sets and Bayesian probability points in the case of several parameters. J. Roy. Statist. Soc. Ser. B, 27, 9-16.
Mathematical Reviews (MathSciNet):
MR191029
[28] Pollard (1984) Convergence of Stochastic Processes. New York: Springer-Verlag.
Mathematical Reviews (MathSciNet):
MR762984
[29] Sowell, F.B. (1992) Maximum likelihood estimation of stationary univariate fractionally integrated time series models. J. Econometrics, 53, 165-188. Abstract can also be found in the ISI/STMA publication
[30] Sweeting, T.J. (1995) A framework for Bayesian and likelihood approximations in statistics. Biometrika, 82, 1-23. Abstract can also be found in the ISI/STMA publication
[31] Tibshirani, R. (1989) Noninformative priors for one parameter of many. Biometrika, 76, 604-608. Abstract can also be found in the ISI/STMA publication
[32] Welch, B. and Peers, H. (1963) On formulae for confidence points based on intervals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B, 25, 318-329.
Mathematical Reviews (MathSciNet):
MR173309