Bayesian Analysis

Invariant Conjugate Analysis for Exponential Families

Pierre Druilhet and Denys Pommeret

Full-text: Open access

Enhanced PDF (427 KB)

Abstract

There are several ways to parameterize a distribution belonging to an exponential family, each one leading to a different Bayesian analysis of the data under standard conjugate priors. To overcome this problem, we propose a new class of conjugate priors which is invariant with respect to smooth reparameterization. This class of priors contains the Jeffreys prior as a special case, according to the value of the hyperparameters. Moreover, these conjugate distributions coincide with the posterior distributions resulting from a Jeffreys prior. Then these priors appear naturally when several datasets are analyzed sequentially and when the Jeffreys prior is chosen for the first dataset. We apply our approach to inverse Gaussian models and propose full invariant analyses of three datasets.

Article information

Source
Bayesian Anal., Volume 7, Number 4 (2012), 903-916.

Dates
First available in Project Euclid: 27 November 2012

Permanent link to this document
https://projecteuclid.org/euclid.ba/1354024467

Digital Object Identifier
doi:10.1214/12-BA731

Mathematical Reviews number (MathSciNet)
MR3000019

Zentralblatt MATH identifier
1330.62119

Keywords
Bayesian inference conjugate prior exponential family inverse Gaussian distribution Jeffreys prior sequential analysis

Citation

Druilhet, Pierre; Pommeret, Denys. Invariant Conjugate Analysis for Exponential Families. Bayesian Anal. 7 (2012), no. 4, 903--916. doi:10.1214/12-BA731. https://projecteuclid.org/euclid.ba/1354024467


Export citation

References

  • Banerjee, A.K. and Bhattacharyya, G.K. (1979). “Bayesian Results for the Inverse Gaussian Distribution with an Application”. Technometrics, 21, 247–251.
    Mathematical Reviews (MathSciNet): MR533253
    Digital Object Identifier: doi:10.1080/00401706.1979.10489756
  • Barndorff-Nielsen, O.E. (1978). Information and exponential families in statistical theory. Wiley, New-York.
    Mathematical Reviews (MathSciNet): MR489333
    Zentralblatt MATH: 0387.62011
  • Chhikara, R.S. and Folks, J.L. (1977). “The inverse Gaussian distribution as a lifetime model”. Technometrics, 4, 461–468
  • Chhikara, R.S. and Folks, J.L. (1989). The Inverse Gaussian Distribution: Theory, Methodology and Applications. Marcel Dekker, Inc. New York and Basel.
    Zentralblatt MATH: 0701.62009
  • Consonni, G. and Veronese, P. (1992). “Conjugate priors for exponential families having quadratic variance functions”. Journal of the American Statistical Association, 87, 1123–1127.
    Mathematical Reviews (MathSciNet): MR1209570
    Zentralblatt MATH: 0764.62027
    Digital Object Identifier: doi:10.1080/01621459.1992.10476268
  • Consonni, G., Veronese, P. and Gutiérrez-Peña, E. (2004). “Reference priors for exponential families with simple quadratic variance function”. Journal of Multivariate Analysis, 88, 335–364.
    Mathematical Reviews (MathSciNet): MR2025617
    Zentralblatt MATH: 1032.62021
    Digital Object Identifier: doi:10.1016/S0047-259X(03)00095-2
  • Cox, D.R. and Miller, H.D. (1965). The Theory of Stochastic Processes. London: Methuen.
    Mathematical Reviews (MathSciNet): MR192521
  • Diaconis, P. and Ylvisaker, D. (1979). “Conjugate priors for exponential families”. The Annals of Statistics, 7, 269–281.
    Mathematical Reviews (MathSciNet): MR520238
    Zentralblatt MATH: 0405.62011
    Digital Object Identifier: doi:10.1214/aos/1176344611
    Project Euclid: euclid.aos/1176344611
  • Druilhet, P. and Marin, J.M. (2007). “Invariant HPD credible sets and MAP estimators”. Bayesian Analysis, 4, 681–692.
    Mathematical Reviews (MathSciNet): MR2361970
    Digital Object Identifier: doi:10.1214/07-BA227
  • Folks, J.L. and Chhikara, R.S. (1978). “The Inverse Gaussian Distribution and its Statistical Application - A Review”. Journal of the Royal Statistical Society B, 40, 263–289.
    Mathematical Reviews (MathSciNet): MR522211
  • Gelman, A. (2004). “Parameterization and Bayesian Modeling”. Journal of the American Statistical Association, 99, 537–545.
    Mathematical Reviews (MathSciNet): MR2109315
    Zentralblatt MATH: 1117.62343
    Digital Object Identifier: doi:10.1198/016214504000000458
  • Gutiérrez-Peña, E. and Rueda, R. (2003). “Reference Priors for Exponential Families”. Journal of Statistical Planning and Inference, 110, 35–54.
    Mathematical Reviews (MathSciNet): MR1944632
    Zentralblatt MATH: 1092.62519
    Digital Object Identifier: doi:10.1016/S0378-3758(01)00281-6
  • Gutiérrez-Peña, E. and Smith, A.F.M. (1995). “Conjugate parametrizations for natural exponential families”. Journal of the American Statistical Association, 90, 1347–1356.
    Mathematical Reviews (MathSciNet): MR1379477
    Zentralblatt MATH: 0868.62029
  • Jeffreys, H. (1946). “An invariant form for the prior probability in estimation problems”. Proceedings of the Royal Society of London, Series A, 186, 453–461.
    Mathematical Reviews (MathSciNet): MR17504
    Digital Object Identifier: doi:10.1098/rspa.1946.0056
  • Jeffreys, H. (1961). Theory of Probability (3rd Edition. ed.). University Press, Oxford.
    Mathematical Reviews (MathSciNet): MR187257
  • Jorgensen, B. (1980). “Statistical properties of the generalized inverse Gaussian distribution”. Memoirs of University of Aarhus, 4.
    Mathematical Reviews (MathSciNet): MR586591
  • Jorgensen, B. (1986). “Some properties of exponential dispersion models”. Scandinavian Journal of Statistics, 13, 187–197.
    Mathematical Reviews (MathSciNet): MR873073
  • Mengersen, K. and Robert, C.P. (1996). “Testing for mixtures: a Bayesian entropic approach”. In J. O. Berger, J. M. Bernardo, A. P. Dawid, D. V. Lindley and A. F. M. Smith (eds), Bayesian Statistics, Vol. 5, 255–76, Oxford University Press.
    Mathematical Reviews (MathSciNet): MR1425410
  • Morris, C.N. (1983). “Natural exponential families with quadratic variance functions: statistical theory”. The Annals of Statistics, 11, 515–529.
    Mathematical Reviews (MathSciNet): MR696064
    Zentralblatt MATH: 0521.62014
    Digital Object Identifier: doi:10.1214/aos/1176346158
    Project Euclid: euclid.aos/1176346158
  • Palmer, J. (1973). “Bayesian analysis of the inverse Gaussian distribution”. Ph.-D. thesis. Oklahoma State University.
  • Robert, C.P. (1991). “Generalized inverse normal distribution”. Statistics & Probability Letters, 11, 37–41.
    Mathematical Reviews (MathSciNet): MR1093416
  • Robert, C.P. and Titterington, D.M. (1998). “Reparameterization strategies for hidden Markov models and Bayesian approaches to maximum likelihood estimation”. Statistics and Computing, 8, 145–158.
    Zentralblatt MATH: 0756.62031
  • Seshadri, V. (1993). The inverse Gaussian distribution: a case study in exponential families. Oxford University Press, New York.
    Mathematical Reviews (MathSciNet): MR1306281
  • Slate, E.H. (1994). “Parameterizations for Natural Exponential Families with Quadratic Variance Functions”. Journal of the American Statistical Association, 89, 1471–1482.
    Mathematical Reviews (MathSciNet): MR1310236
    Zentralblatt MATH: 0810.62019
    Digital Object Identifier: doi:10.1080/01621459.1994.10476886
  • Tweedie, M.C.K. (1956). “Some statistical properties of inverse Gaussian distributions”. Virginia Journal of Sciences (N.S.), 7, 160–165.
    Mathematical Reviews (MathSciNet): MR84957
  • Whitmore, G. A. (1979). “An Inverse Gaussian Model for Labour Turnover”. Journal of the Royal Statistical Society (Serie A), 142, 468–478.
  • Zwickl, D.J. and Holder, M.T. (2004). “Model Parameterization, Prior Distributions, and the General Time-Reversible Model in Bayesian Phylogenetics” Systematic Biology, 53, 877–888.

International Society for Bayesian Analysis

Bayesian Analysis

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more