In multi-parameter models, reference priors typically depend on the parameter or quantity of interest, and it is well known that this is necessary to produce objective posterior distributions with optimal properties. There are, however, many situations where one is simultaneously interested in all the parameters of the model or, more realistically, in functions of them that include aspects such as prediction, and it would then be useful to have a single objective prior that could safely be used to produce reasonable posterior inferences for all the quantities of interest. In this paper, we consider three methods for selecting a single objective prior and study, in a variety of problems including the multinomial problem, whether or not the resulting prior is a reasonable overall prior.
References
Bar-Lev, S. K. and Reiser, B. (1982). An exponential subfamily which admits UMPU tests based on a single test statistic. The Annals of Statistics 10, 979–989. MR663449 10.1214/aos/1176345888 euclid.aos/1176345888
Bar-Lev, S. K. and Reiser, B. (1982). An exponential subfamily which admits UMPU tests based on a single test statistic. The Annals of Statistics 10, 979–989. MR663449 10.1214/aos/1176345888 euclid.aos/1176345888
Berger, J. O. and Bernardo, J. M. (1989). Estimating a product of means: Bayesian analysis with reference priors. Journal of the American Statistical Association 84, 200–207. MR999679 10.1080/01621459.1989.10478756Berger, J. O. and Bernardo, J. M. (1989). Estimating a product of means: Bayesian analysis with reference priors. Journal of the American Statistical Association 84, 200–207. MR999679 10.1080/01621459.1989.10478756
Berger, J. O. and Bernardo, J. M. (1992a). On the development of reference priors. Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) Oxford: University Press, 35–60 (with discussion). MR1380269Berger, J. O. and Bernardo, J. M. (1992a). On the development of reference priors. Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) Oxford: University Press, 35–60 (with discussion). MR1380269
Berger, J. O. and Bernardo, J. M. (1992b). Ordered group reference priors, with applications to multinomial problems. Biometrika 79, 25–37. MR1158515 10.1093/biomet/79.1.25Berger, J. O. and Bernardo, J. M. (1992b). Ordered group reference priors, with applications to multinomial problems. Biometrika 79, 25–37. MR1158515 10.1093/biomet/79.1.25
Berger, J. O., Bernardo, J. M. and Sun, D. (2009). The formal definition of reference priors. The Annals of Statistics 37, 905–938. MR2502655 10.1214/07-AOS587 euclid.aos/1236693154
Berger, J. O., Bernardo, J. M. and Sun, D. (2009). The formal definition of reference priors. The Annals of Statistics 37, 905–938. MR2502655 10.1214/07-AOS587 euclid.aos/1236693154
Berger, J. O., Bernardo, J. M. and Sun, D. (2012). Objective priors for discrete parameter spaces. Journal of the American Statistical Association 107, 636-648. MR2980073 10.1080/01621459.2012.682538Berger, J. O., Bernardo, J. M. and Sun, D. (2012). Objective priors for discrete parameter spaces. Journal of the American Statistical Association 107, 636-648. MR2980073 10.1080/01621459.2012.682538
Berger, J. O. and Sun, D. (2008). Objective priors for the bivariate normal model. The Annals of Statistics 36, 963–982. MR2396821 10.1214/07-AOS501 euclid.aos/1205420525
Berger, J. O. and Sun, D. (2008). Objective priors for the bivariate normal model. The Annals of Statistics 36, 963–982. MR2396821 10.1214/07-AOS501 euclid.aos/1205420525
Bernardo, J. M. (1979). Reference posterior distributions for Bayesian inference. Journal of the Royal Statistical Society, Series B 41, 113–147 (with discussion). MR547240Bernardo, J. M. (1979). Reference posterior distributions for Bayesian inference. Journal of the Royal Statistical Society, Series B 41, 113–147 (with discussion). MR547240
Bernardo, J. M. (2005). Reference analysis. Bayesian Thinking: Modeling and Computation, Handbook of Statistics 25 (D. K. Dey and C. R Rao, eds). Amsterdam: Elsevier, 17–90. MR2490522 10.1016/S0169-7161(05)25002-2Bernardo, J. M. (2005). Reference analysis. Bayesian Thinking: Modeling and Computation, Handbook of Statistics 25 (D. K. Dey and C. R Rao, eds). Amsterdam: Elsevier, 17–90. MR2490522 10.1016/S0169-7161(05)25002-2
Bernardo, J. M. (2011). Integrated objective Bayesian estimation and hypothesis testing. Bayesian Statistics 9 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) Oxford: University Press, 1–68 (with discussion). MR3204001 10.1093/acprof:oso/9780199694587.003.0001Bernardo, J. M. (2011). Integrated objective Bayesian estimation and hypothesis testing. Bayesian Statistics 9 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) Oxford: University Press, 1–68 (with discussion). MR3204001 10.1093/acprof:oso/9780199694587.003.0001
Bernardo, J. M. (2006). Intrinsic point estimation of the normal variance. Bayesian Statistics and its Applications. (S. K. Upadhyay, U. Singh and D. K. Dey, eds.) New Delhi: Anamaya Pub, 110–121.Bernardo, J. M. (2006). Intrinsic point estimation of the normal variance. Bayesian Statistics and its Applications. (S. K. Upadhyay, U. Singh and D. K. Dey, eds.) New Delhi: Anamaya Pub, 110–121.
Clarke, B. and Barron, A. (1994). Jeffreys’ prior is the reference prior under entropy loss. Journal of Statistical Planning and Inference 41, 37–60. MR1292146 10.1016/0378-3758(94)90153-8Clarke, B. and Barron, A. (1994). Jeffreys’ prior is the reference prior under entropy loss. Journal of Statistical Planning and Inference 41, 37–60. MR1292146 10.1016/0378-3758(94)90153-8
Clarke, B. and Yuan A. (2004). Partial information reference priors: derivation and interpretations. Journal of Statistical Planning and Inference 123, 313–345. MR2062985 10.1016/S0378-3758(03)00157-5Clarke, B. and Yuan A. (2004). Partial information reference priors: derivation and interpretations. Journal of Statistical Planning and Inference 123, 313–345. MR2062985 10.1016/S0378-3758(03)00157-5
Consonni, G., Veronese, P. and Gutiérrez-Peña E. (2004). Reference priors for exponential families with simple quadratic variance function. J. Multivariate Analysis 88, 335–364. MR2025617 10.1016/S0047-259X(03)00095-2Consonni, G., Veronese, P. and Gutiérrez-Peña E. (2004). Reference priors for exponential families with simple quadratic variance function. J. Multivariate Analysis 88, 335–364. MR2025617 10.1016/S0047-259X(03)00095-2
Crowder, M. and Sweeting, T. (1989). Bayesian inference for a bivariate binomial distribution. Biometrika 76, 599–603. MR1040653 10.1093/biomet/76.3.599Crowder, M. and Sweeting, T. (1989). Bayesian inference for a bivariate binomial distribution. Biometrika 76, 599–603. MR1040653 10.1093/biomet/76.3.599
Datta, G. S. and Ghosh, J. K. (1995a). On priors providing frequentist validity for Bayesian inference. Biometrika 82, 37–45. MR1332838 10.2307/2337625Datta, G. S. and Ghosh, J. K. (1995a). On priors providing frequentist validity for Bayesian inference. Biometrika 82, 37–45. MR1332838 10.2307/2337625
Datta, G. S. and Ghosh, J. K. (1995b). Noninformative priors for maximal invariant parameter in group models. Test 4, 95–114. MR1365042 10.1007/BF02563105Datta, G. S. and Ghosh, J. K. (1995b). Noninformative priors for maximal invariant parameter in group models. Test 4, 95–114. MR1365042 10.1007/BF02563105
Datta, G. S. and Ghosh, M. (1996). On the invariance of noninformative priors. The Annals of Statistics 24, 141–159. MR1389884 10.1214/aos/1033066203 euclid.aos/1033066203
Datta, G. S. and Ghosh, M. (1996). On the invariance of noninformative priors. The Annals of Statistics 24, 141–159. MR1389884 10.1214/aos/1033066203 euclid.aos/1033066203
Datta, G. S., Mukerjee, R., Ghosh, M. and Sweeting, T. J. (2000). Bayesian prediction with approximate frequentist validity. The Annals of Statistics 28, 1414–1426. MR1805790 10.1214/aos/1015957400 euclid.aos/1015957400
Datta, G. S., Mukerjee, R., Ghosh, M. and Sweeting, T. J. (2000). Bayesian prediction with approximate frequentist validity. The Annals of Statistics 28, 1414–1426. MR1805790 10.1214/aos/1015957400 euclid.aos/1015957400
De Santis, F., Mortea, J. and Nardi, A. (2001). Jeffreys priors for survival models with censored data. Journal of Statistical Planning and Inference 99, 193–209. MR1865291 10.1016/S0378-3758(01)00080-5De Santis, F., Mortea, J. and Nardi, A. (2001). Jeffreys priors for survival models with censored data. Journal of Statistical Planning and Inference 99, 193–209. MR1865291 10.1016/S0378-3758(01)00080-5
De Santis, F. (2006). Power priors and their use in clinical trials. The American Statistician 60, 122–129. MR2224209 10.1198/000313006X109269De Santis, F. (2006). Power priors and their use in clinical trials. The American Statistician 60, 122–129. MR2224209 10.1198/000313006X109269
Ghosh, M., Mergel, V., and Liu, R. (2011). A general divergence criterion for prior selection. Annals of the Institute of Statistical Mathematics 60, 43–58. MR2748933 10.1007/s10463-009-0226-4Ghosh, M., Mergel, V., and Liu, R. (2011). A general divergence criterion for prior selection. Annals of the Institute of Statistical Mathematics 60, 43–58. MR2748933 10.1007/s10463-009-0226-4
Ghosh, M. (2011). Objective priors: An introduction for frequentists. Statistical Science 26, 187–202. MR2858380 10.1214/10-STS338 euclid.ss/1312204006
Ghosh, M. (2011). Objective priors: An introduction for frequentists. Statistical Science 26, 187–202. MR2858380 10.1214/10-STS338 euclid.ss/1312204006
Ghosh, M. and Sun, D. (1998). Recent developments of Bayesian inference for stress-strength models. Frontiers in Reliability. Indian Association for Productivity Quality and Reliability (IAPQR), 143-158.Ghosh, M. and Sun, D. (1998). Recent developments of Bayesian inference for stress-strength models. Frontiers in Reliability. Indian Association for Productivity Quality and Reliability (IAPQR), 143-158.
Hartigan, J. A. (1964). Invariant prior distributions. Annals of Mathematical Statistics 35, 836–845. MR161406 10.1214/aoms/1177703583 euclid.aoms/1177703583
Hartigan, J. A. (1964). Invariant prior distributions. Annals of Mathematical Statistics 35, 836–845. MR161406 10.1214/aoms/1177703583 euclid.aoms/1177703583
Jeffreys, H. (1946). An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society, Series A 186, 453–461. MR17504 10.1098/rspa.1946.0056Jeffreys, H. (1946). An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society, Series A 186, 453–461. MR17504 10.1098/rspa.1946.0056
Kass, R. E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. Journal of the American Statistical Association 91, 1343–1370. MR1478684 10.1214/lnms/1215453065Kass, R. E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. Journal of the American Statistical Association 91, 1343–1370. MR1478684 10.1214/lnms/1215453065
Kullback, S. and R. A. Leibler, R.A. (1951). On information and suffiency. Annals of Mathematical Statistics 22, 79–86. MR39968 10.1214/aoms/1177729694 euclid.aoms/1177729694
Kullback, S. and R. A. Leibler, R.A. (1951). On information and suffiency. Annals of Mathematical Statistics 22, 79–86. MR39968 10.1214/aoms/1177729694 euclid.aoms/1177729694
Laplace, P. S. (1812). Théorie Analytique des Probabilités. Paris: Courcier. Reprinted as Oeuvres Complètes de Laplace 7, 1878–1912. Paris: Gauthier-Villars.Laplace, P. S. (1812). Théorie Analytique des Probabilités. Paris: Courcier. Reprinted as Oeuvres Complètes de Laplace 7, 1878–1912. Paris: Gauthier-Villars.
Liseo, B. (1993). Elimination of nuisance parameters with reference priors. Biometrika 80, 295-304. MR1243505 10.1093/biomet/80.2.295Liseo, B. (1993). Elimination of nuisance parameters with reference priors. Biometrika 80, 295-304. MR1243505 10.1093/biomet/80.2.295
Liseo, B, and Loperfido, N, (2006). A note on reference priors for the scalar skew-normal distribution. Journal of Statistical Planning and Inference 136, 373–389. MR2211345 10.1016/j.jspi.2004.06.062Liseo, B, and Loperfido, N, (2006). A note on reference priors for the scalar skew-normal distribution. Journal of Statistical Planning and Inference 136, 373–389. MR2211345 10.1016/j.jspi.2004.06.062
Polson, N. and Wasserman, L. (1990). Prior distributions for the bivariate binomial. Biometrika 77, 901–904. MR1086698 10.1093/biomet/77.4.901Polson, N. and Wasserman, L. (1990). Prior distributions for the bivariate binomial. Biometrika 77, 901–904. MR1086698 10.1093/biomet/77.4.901
Sivaganesan, S., Laud, P., Mueller, P. (2011). A Bayesian subgroup analysis using zero-inflated Polya-urn scheme. Sociological Methodology 30, 312–323. MR2758864 10.1002/sim.4108Sivaganesan, S., Laud, P., Mueller, P. (2011). A Bayesian subgroup analysis using zero-inflated Polya-urn scheme. Sociological Methodology 30, 312–323. MR2758864 10.1002/sim.4108
Stein, C. (1959). An example of wide discrepancy between fiducial and confidence intervals. Annals of mathematical Statistics 30, 877–880. MR125680 10.1214/aoms/1177706072 euclid.aoms/1177706072
Stein, C. (1959). An example of wide discrepancy between fiducial and confidence intervals. Annals of mathematical Statistics 30, 877–880. MR125680 10.1214/aoms/1177706072 euclid.aoms/1177706072
Stein, C. (1964). Inadmissibility of the usual estimator for the variance of a normal distribution with unknown mean. Annals of the Institute of Statistical Mathematics 16, 155–160. MR171344 10.1007/BF02868569Stein, C. (1964). Inadmissibility of the usual estimator for the variance of a normal distribution with unknown mean. Annals of the Institute of Statistical Mathematics 16, 155–160. MR171344 10.1007/BF02868569
Stone, M. and Dawid, A. P. (1972). Un-Bayesian implications of improper Bayesian inference in routine statistical problems. Biometrika 59, 269–375. MR431449 10.1093/biomet/59.2.369Stone, M. and Dawid, A. P. (1972). Un-Bayesian implications of improper Bayesian inference in routine statistical problems. Biometrika 59, 269–375. MR431449 10.1093/biomet/59.2.369
Sun, D. (1994). Integrable expansions for posterior distributions for a two-parameter exponential family. The Annals of Statistics 22, 1808-1830. MR1329169 10.1214/aos/1176325758 euclid.aos/1176325758
Sun, D. (1994). Integrable expansions for posterior distributions for a two-parameter exponential family. The Annals of Statistics 22, 1808-1830. MR1329169 10.1214/aos/1176325758 euclid.aos/1176325758
Sun, D. and Ye, K. (1996). Frequentist validity of posterior quantiles for a two-parameter exponential family. Biometrika 83, 55-65. MR1399155 10.1093/biomet/83.1.55Sun, D. and Ye, K. (1996). Frequentist validity of posterior quantiles for a two-parameter exponential family. Biometrika 83, 55-65. MR1399155 10.1093/biomet/83.1.55
Sun, D. and Berger, J. O. (1998). Reference priors under partial information. Biometrika 85, 55–71. MR1627242 10.1093/biomet/85.1.55Sun, D. and Berger, J. O. (1998). Reference priors under partial information. Biometrika 85, 55–71. MR1627242 10.1093/biomet/85.1.55
Sun, D. and Berger, J. O. (2007). Objective Bayesian analysis for the multivariate normal model. Bayesian Statistics 8 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) Oxford: University Press, 525–562 (with discussion). MR2433206Sun, D. and Berger, J. O. (2007). Objective Bayesian analysis for the multivariate normal model. Bayesian Statistics 8 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) Oxford: University Press, 525–562 (with discussion). MR2433206
Walker, S. G. and Gutiérrez-Peña, E. (2011). A decision-theoretical view of default priors Theory and Decision 70, 1–11. MR2753400 10.1007/s11238-009-9174-yWalker, S. G. and Gutiérrez-Peña, E. (2011). A decision-theoretical view of default priors Theory and Decision 70, 1–11. MR2753400 10.1007/s11238-009-9174-y
Yang, R. and Berger, J. O. (1994). Estimation of a covariance matrix using the reference prior. The Annals of Statistics 22, 1195–2111. MR1311972 10.1214/aos/1176325625 euclid.aos/1176325625
Yang, R. and Berger, J. O. (1994). Estimation of a covariance matrix using the reference prior. The Annals of Statistics 22, 1195–2111. MR1311972 10.1214/aos/1176325625 euclid.aos/1176325625
