Bernoulli

Non-informative priors in the case of Gaussian long-memory processes

Anne Philippe and Judith Rousseau
Source: Bernoulli Volume 8, Number 4 (2002), 451-473.

Abstract

In this paper, we consider an asymptotic Bayesian analysis for Gaussian processes with long memory. First, we determine the asymptotic expansion of the posterior density based on a normal approximation. This expansion leads to the construction of Bayesian confidence regions such as highest posterior density regions and to the determination of matching prior. Then, we generalize Clarke and Barron's result in the long-memory set-up. More precisely, we establish the asymptotic expansion of the Kullback-Leibler distance between the true density and the marginal density of the observations. As in the independent and identically distributed case, this result gives an asymptotic justification of Berger and Bernardo's algorithm to obtain reference priors.

First Page: Show Hide
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.bj/1078681379
Mathematical Reviews number (MathSciNet): MR2003f:60071
Zentralblatt MATH identifier: 1003.62026

References

[1] Beran, J. (1994) Statistics for Long Memory Processes. London: Chapman & Hall.
Mathematical Reviews (MathSciNet): MR1304490
Zentralblatt MATH: 0869.60045
[2] Berger, J.O. and Bernardo, J.M. (1989) Estimating a product of means - Bayesian analysis with reference priors. J. Amer. Statist. Assoc., 84, 200-207. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR999679
Zentralblatt MATH: 0682.62018
[3] Berger, J. and Bernardo, J. (1992a) Reference priors in a variance components problem. In P.K. Goel and N.S. Iyengar (eds), Bayesian Analysis in Statistics and Econometrics. New York: Springer- Verlag.
[4] Berger, J. and Bernardo, J. (1992b) On the development of the reference prior method. In J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith (eds), Bayesian Statistics 4, pp. 35-49. Oxford: Oxford University Press.
Mathematical Reviews (MathSciNet): MR1380269
[5] Bernardo, J.M. (1979) Reference posterior distributions for Bayesian inference (with discussion). J. Roy. Statist. Soc. Ser. B, 41, 113-147.
Mathematical Reviews (MathSciNet): MR547240
[6] Carlin, J., Dempster, A.P. and Jonas, A.B. (1985) On models and methods for Bayesian time series analysis. J. Econometrics, 30, 67-90. \n
Mathematical Reviews (MathSciNet): MR835574
Digital Object Identifier: doi:10.1016/0304-4076(85)90132-0
[7] Clarke, B. and Barron, A. (1990) Information-theoretic asymptotics of Bayes methods. IEEE Trans. Inform. Theory, 36, 453-471.
Mathematical Reviews (MathSciNet): MR1053841
Digital Object Identifier: doi:10.1109/18.54897
[8] Clarke, B. and Sun, D. (1997) Reference priors under the chi-squared distance. Sankhya Ser. A, 59, 215-231. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1665703
[9] Dahlhaus R. (1989) Efficient parameter estimation for self-similar processes, Ann. Statist., 17, 1749-1766.
Mathematical Reviews (MathSciNet): MR1026311
Zentralblatt MATH: 0703.62091
Digital Object Identifier: doi:10.1214/aos/1176347393
Project Euclid: euclid.aos/1176347393
[10] Datta, G.S. (1996) On priors providing frequentist validity for Bayesian parametric functions. Biometrika, 83, 287-298. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1439784
Zentralblatt MATH: 0903.62002
Digital Object Identifier: doi:10.1093/biomet/83.2.287
[11] Datta, G.S. and Ghosh, J.K. (1995) On priors providing frequentist validity for Bayesian inference. Biometrika, 82, 37-45. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1332838
Digital Object Identifier: doi:10.2307/2337625
[12] Fox, R. and Taqqu, M.S. (1986) Large sample properties of parameter estimates for strongly dependent stationary Gaussian time series. Ann. Statist., 14, 517-532.
Mathematical Reviews (MathSciNet): MR840512
Zentralblatt MATH: 0606.62096
Digital Object Identifier: doi:10.1214/aos/1176349936
Project Euclid: euclid.aos/1176349936
[13] Geyer, C. (1999) Likelihood inference for spatial point processes. In Stochastic Geometry, Likelihood and Computation., O.E. Barndorff-Nielsen, W.S. Kendall and M.N.M. van Lieshout (Eds). London: Chapman & Hall.
Mathematical Reviews (MathSciNet): MR1673118
Zentralblatt MATH: 0809.62089
[14] Ghosh, J.K. and Mukerjee, R. (1992) Non-informative prior. In J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith (eds), Bayesian Statistics 4, pp. 195-203. Oxford: Oxford University Press. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1380277
Zentralblatt MATH: 0904.62007
[15] Ghosh, J.K. and Mukerjee, R. (1993) Frequentist validity of highest posterior density regions in the multiparameter case. Ann. Inst. Statist. Math., 45, 293-302. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1232496
Zentralblatt MATH: 0778.62024
Digital Object Identifier: doi:10.1007/BF00775815
[16] Ghosh, M., Carlin, B.P. and Srivastava, M.S. (1995) Probability matching priors for linear calibration. T.E.S.T., 4, 333-358. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1379796
Zentralblatt MATH: 0844.62024
Digital Object Identifier: doi:10.1007/BF02562631
[17] Giraitis, L. and Surgalis, D. (1990) A central limit theorem for quadratic forms in strongly dependent linear variables and its applications to asymptotic normality of Whittlés estimate. Probab. Theory Related Fields., 86, 87-104.
Mathematical Reviews (MathSciNet): MR1061950
Zentralblatt MATH: 0717.62015
Digital Object Identifier: doi:10.1007/BF01207515
[18] Granger, C.W.J. and Joyeux, R. (1980) An introduction to long memory time series models and fractional differencing. J. Time Ser. Anal., 1, 15-29.
Mathematical Reviews (MathSciNet): MR605572
Zentralblatt MATH: 0503.62079
Digital Object Identifier: doi:10.1111/j.1467-9892.1980.tb00297.x
[19] Hosking, J.R.M. (1981) Fractional differencing. Biometrika, 68, 165-176.
Mathematical Reviews (MathSciNet): MR614953
Zentralblatt MATH: 0464.62088
Digital Object Identifier: doi:10.1093/biomet/68.1.165
[20] Johnson, R.A. (1970) Asymptotic expansions associated with posterior distributions. Ann. Math. Statist., 41, 851-864.
Mathematical Reviews (MathSciNet): MR263198
Zentralblatt MATH: 0204.53002
Digital Object Identifier: doi:10.1214/aoms/1177696963
Project Euclid: euclid.aoms/1177696963
[21] Koop, G., Ley, E., Osiewalski, J. and Steel, M.F.J. (1994) Posterior properties of long-run impulse responses. J. Business Econom. Statist., 12, 489-492. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1304827
[22] Koop, G., Ley, E., Osiewalski, J. and Steel, M.F.J. (1997) Bayesian analysis of long memory and persistence using ARFIMA models. J. Econometrics, 76, 149-169. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1435885
Zentralblatt MATH: 0873.62091
Digital Object Identifier: doi:10.1016/0304-4076(95)01787-9
[23] Lieberman, O., Rousseau, J. and Zucker, D.M. (1999) Valid asymptotic expansions for the maximum likelihood estimator of the parameter of a stationary, Gaussian, strongly dependent process. Preprint.
Mathematical Reviews (MathSciNet): MR1983543
Digital Object Identifier: doi:10.1214/aos/1051027882
Project Euclid: euclid.aos/1051027882
[24] Mukerjee, R. and Dey, D.K. (1993) Frequentist validity of posterior quantiles in the presence of nuisance parameter: higher order asymptotics. Biometrika, 80, 499-505. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1248017
Zentralblatt MATH: 0788.62025
Digital Object Identifier: doi:10.1093/biomet/80.3.499
[25] Osiewalski, J. and Steel, M.F.J. (1993) Bayesian marginal equivalence of elliptical regression models. J. Econometrics, 59, 391-403. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1242037
Zentralblatt MATH: 0786.62044
Digital Object Identifier: doi:10.1016/0304-4076(93)90032-Z
[26] Pai, J.S. and Ravishanker, N. (1998) Bayesian analysis of autoregressive fractionally integrated moving-average processes. J. Time Ser. Anal., 19, 99-112. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1624112
Zentralblatt MATH: 0902.62111
Digital Object Identifier: doi:10.1111/1467-9892.00079
[27] Peers, H.W. (1965) On confidence sets and Bayesian probability points in the case of several parameters. J. Roy. Statist. Soc. Ser. B, 27, 9-16.
Mathematical Reviews (MathSciNet): MR191029
[28] Pollard (1984) Convergence of Stochastic Processes. New York: Springer-Verlag.
Mathematical Reviews (MathSciNet): MR762984
Zentralblatt MATH: 0544.60045
[29] Sowell, F.B. (1992) Maximum likelihood estimation of stationary univariate fractionally integrated time series models. J. Econometrics, 53, 165-188. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1185210
Digital Object Identifier: doi:10.1016/0304-4076(92)90084-5
[30] Sweeting, T.J. (1995) A framework for Bayesian and likelihood approximations in statistics. Biometrika, 82, 1-23. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1332836
Zentralblatt MATH: 0829.62003
Digital Object Identifier: doi:10.1093/biomet/82.1.1
[31] Tibshirani, R. (1989) Noninformative priors for one parameter of many. Biometrika, 76, 604-608. Abstract can also be found in the ISI/STMA publication
Mathematical Reviews (MathSciNet): MR1040654
Zentralblatt MATH: 0678.62010
Digital Object Identifier: doi:10.1093/biomet/76.3.604
[32] Welch, B. and Peers, H. (1963) On formulae for confidence points based on intervals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B, 25, 318-329.
Mathematical Reviews (MathSciNet): MR173309

2012 © Bernoulli Society for Mathematical Statistics and Probability

Bernoulli

Bernoulli

Turn MathJax Off
What is MathJax?