Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 6 (2012), 382-420.
Classification via local multi-resolution projections
We focus on the supervised binary classification problem, which consists in guessing the label Y associated to a co-variate X∈ℝd, given a set of n independent and identically distributed co-variates and associated labels (Xi,Yi). We assume that the law of the random vector (X,Y) is unknown and the marginal law of X admits a density supported on a set . In the particular case of plug-in classifiers, solving the classification problem boils down to the estimation of the regression function . Assuming first to be known, we show how it is possible to construct an estimator of η by localized projections onto a multi-resolution analysis (MRA). In a second step, we show how this estimation procedure generalizes to the case where is unknown. Interestingly, this novel estimation procedure presents similar theoretical performances as the celebrated local-polynomial estimator (LPE). In addition, it benefits from the lattice structure of the underlying MRA and thus outperforms the LPE from a computational standpoint, which turns out to be a crucial feature in many practical applications. Finally, we prove that the associated plug-in classifier can reach super-fast rates under a margin assumption.
Electron. J. Statist., Volume 6 (2012), 382-420.
First available in Project Euclid: 19 March 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Monnier, Jean-Baptiste. Classification via local multi-resolution projections. Electron. J. Statist. 6 (2012), 382--420. doi:10.1214/12-EJS677. https://projecteuclid.org/euclid.ejs/1332162334