The Annals of Statistics
- Ann. Statist.
- Volume 38, Number 2 (2010), 1071-1093.
Optimal properties of centroid-based classifiers for very high-dimensional data
We show that scale-adjusted versions of the centroid-based classifier enjoys optimal properties when used to discriminate between two very high-dimensional populations where the principal differences are in location. The scale adjustment removes the tendency of scale differences to confound differences in means. Certain other distance-based methods, for example, those founded on nearest-neighbor distance, do not have optimal performance in the sense that we propose. Our results permit varying degrees of sparsity and signal strength to be treated, and require only mild conditions on dependence of vector components. Additionally, we permit the marginal distributions of vector components to vary extensively. In addition to providing theory we explore numerical properties of a centroid-based classifier, and show that these features reflect theoretical accounts of performance.
Ann. Statist., Volume 38, Number 2 (2010), 1071-1093.
First available in Project Euclid: 19 February 2010
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Hall, Peter; Pham, Tung. Optimal properties of centroid-based classifiers for very high-dimensional data. Ann. Statist. 38 (2010), no. 2, 1071--1093. doi:10.1214/09-AOS736. https://projecteuclid.org/euclid.aos/1266586623