The Annals of Statistics
- Ann. Statist.
- Volume 35, Number 5 (2007), 2287-2311.
Spatial aggregation of local likelihood estimates with applications to classification
This paper presents a new method for spatially adaptive local (constant) likelihood estimation which applies to a broad class of nonparametric models, including the Gaussian, Poisson and binary response models. The main idea of the method is, given a sequence of local likelihood estimates (“weak” estimates), to construct a new aggregated estimate whose pointwise risk is of order of the smallest risk among all “weak” estimates. We also propose a new approach toward selecting the parameters of the procedure by providing the prescribed behavior of the resulting estimate in the simple parametric situation. We establish a number of important theoretical results concerning the optimality of the aggregated estimate. In particular, our “oracle” result claims that its risk is, up to some logarithmic multiplier, equal to the smallest risk for the given family of estimates. The performance of the procedure is illustrated by application to the classification problem. A numerical study demonstrates its reasonable performance in simulated and real-life examples.
Ann. Statist., Volume 35, Number 5 (2007), 2287-2311.
First available in Project Euclid: 7 November 2007
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62G05: Estimation
Secondary: 62G07: Density estimation 62G08: Nonparametric regression 62G32: Statistics of extreme values; tail inference 62H30: Classification and discrimination; cluster analysis [See also 68T10, 91C20]
Belomestny, Denis; Spokoiny, Vladimir. Spatial aggregation of local likelihood estimates with applications to classification. Ann. Statist. 35 (2007), no. 5, 2287--2311. doi:10.1214/009053607000000271. https://projecteuclid.org/euclid.aos/1194461731