John A. Hartigan
We evaluate priors by the second order asymptotic behaviour of the corresponding estimators. Under certain regularity conditions, the risk differences between efficient estimators of parameters taking values in a domain D, an open connected subset of Rd, are asymptotically expressed as elliptic differential forms depending on the asymptotic covariance matrix V. Each efficient estimator has the same asymptotic risk as a “local Bayes” estimate corresponding to a prior density p. The asymptotic decision theory of the estimators identifies the smooth prior densities as admissible or inadmissible, according to the existence of solutions to certain elliptic differential equations. The prior p is admissible if the quantity pV is sufficiently small near the boundary of D. We exhibit the unique admissible invariant prior for V=I, D=Rd−{0}. A detailed example is given for a normal mixture model.
References
[Br71] Brown, L. D., Admissible estimators, recurrent diffusions, and insoluble boundary value problems, Ann. Math. Statist 42 (1971), 855–903.
Mathematical Reviews (MathSciNet):
MR286209
[Br79] Brown, L. D., A heuristic method for determining admissibility of estimators with applications, Ann. Statist 7 (1979), 960–994.
Mathematical Reviews (MathSciNet):
MR536501
[Em03] Emerson, J., Asymptotic Admissibility and Bayesian Estimation Ph.D. dissertation, Yale University, (2003) 180 pp. [Available from University Microfilm, 305 N. Zeeb Rd., Ann Arbor, MI 48106.]
[KW96] Kass, R. E. and Wasserman, L. A., The selection of prior distributions by formal rules, J. Amer. Statist. Assoc. 91(1996), 1343–1370.
[GS98] Gilbarg, D. and Trudinger, N. S. Elliptic Partial Differential Equations of Second Order, Springer-Verlag, Berlin, 1998.
[Ha98] Hartigan, J. A., The Maximum Likelihood Prior, Ann. Statist. 35 (1998), 2083–2103.
[Ic78] Ichihara, K., Some global properties of symmetric diffusion processes, Publ. RIMS Kyoto University, 14 (1978), 441–486.
Mathematical Reviews (MathSciNet):
MR509198
[Le82] Levit, B. Ya., Minimax estimation and positive solutions of elliptic equations, Theory Probab. Appl. 27 (1982), 563–586.
Mathematical Reviews (MathSciNet):
MR673924
[Le83] Levit, B. Ya., Second-order availability and positive solutions of the Schrodinger equation, Lecture Notes in Math (1021) Springer, Berlin, 1983, pp. 372–385.
Mathematical Reviews (MathSciNet):
MR736005
[Le85] Levit, B. Ya., Second-order asymptotic optimality and positive solutions of Schrodinger’s equation, Theory Probab. Appl. 30 (1985), 333–363.
Mathematical Reviews (MathSciNet):
MR792622
[Pi95] Pinsky, R. G., Positive Harmonic Functions and Diffusion, Cambridge University Press, Cambridge, 1995.
[St56] Stein, C., Inadmissibility of the usual estimator for the mean of a multivariate normal distribution, Proc. Third Berkeley Symp. Math. Statist. Probab.(1) Univ. California Press, Berkeley, 1956, pp. 197–206.
Mathematical Reviews (MathSciNet):
MR84922
[SC71] Strawderman, W.E. and Cohen, A., Admissibility of Estimators of the Mean Vector of a Multivariate Normal Distribution with Quadratic Loss, Ann. Math. Statist. 42 (1971), 270–296.
Mathematical Reviews (MathSciNet):
MR281293