We consider the classical problem of estimating a vector μ=(μ1, …, μn) based on independent observations Yi∼N(μi, 1), i=1, …, n.
Suppose μi, i=1, …, n are independent realizations from a completely unknown G. We suggest an easily computed estimator μ̂, such that the ratio of its risk E(μ̂−μ)2 with that of the Bayes procedure approaches 1. A related compound decision result is also obtained.
Our asymptotics is of a triangular array; that is, we allow the distribution G to depend on n. Thus, our theoretical asymptotic results are also meaningful in situations where the vector μ is sparse and the proportion of zero coordinates approaches 1.
We demonstrate the performance of our estimator in simulations, emphasizing sparse setups. In “moderately-sparse” situations, our procedure performs very well compared to known procedures tailored for sparse setups. It also adapts well to nonsparse situations.
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription.
Read more about accessing full-text
References
Brown, L. D. (1971). Admissible estimators, recurrent diffusions, and insoluble boundary value problems. Ann. Math. Statist. 42 855–904.
Mathematical Reviews (MathSciNet):
MR286209
Brown, L. D. (2008). In-season prediction of bating averages: A field test of simple empirical Bayes and Bayes methodologies. Ann. Appl. Statist. 2 113–152.
Copas, J. B. (1969). Compound decisions and empirical Bayes (with discussion). J. Roy. Statist. Soc. Ser. B 31 397–425.
Mathematical Reviews (MathSciNet):
MR269013
Donoho, D. L. and Johnstone, I. M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika 81 425–455.
Efron, B. (2003). Robbins, empirical Bayes, and microarrays. Ann. Statist. 31 366–378.
Greenshtein, E. and Park, J. (2007). Application of nonparametric empirical Bayes to high-dimensional classification.
Greenshtein, E. and Ritov, Y. (2008). Asymptotic efficiency of simple decisions for the compound decision problem. In The 3rd Lehmann Symposium (J. Rojo, ed.). IMS Lecture Notes Monograph. To appear.
Johnstone, I. M. and Silverman, B. W. (2004). Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist. 32 1594–1649.
Robbins, H. (1951). Asymptotically subminimax solutions of compound decision problems. In Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability, 1950 131–148. Univ. California, Berkeley.
Mathematical Reviews (MathSciNet):
MR44803
Robbins, H. (1956). An empirical Bayes approach to statistics. In Proc. Third Berkeley Symp. 157–164. Univ. California Press, Berkeley.
Mathematical Reviews (MathSciNet):
MR84919
Robbins, H. (1964). The empirical Bayes approach to statistical decision problems. Ann. Math. Statist. 35 1–20.
Mathematical Reviews (MathSciNet):
MR163407
Samuel, E. (1965). On simple rules for the compound decision problem. J. Roy. Statist. Soc. Ser. B 27 238–244.
Mathematical Reviews (MathSciNet):
MR205411
van der Vaart, A. W. and Wellner, J. (1996). Weak Convergence and Empirical Processes. Springer, New York.
Wenhua, J. and Zhang, C.-H. (2007). General maximum likelihood empirical Bayes estimation of normal means. Manuscript.
Zhang, C.-H. (1997). Empirical Bayes and compound estimation of a normal mean. Statist. Sinica 7 181–193.
Zhang, C.-H. (2003). Compound decision theory and empirical Bayes methods (invited paper). Ann. Statist. 31 379–390.
Zhang C.-H. (2005). General empirical Bayes wavelet methods and exactly adaptive minimax estimation. Ann. Statist. 33 54–100.
