- Statist. Surv.
- Volume 4 (2010), 148-183.
Primal and dual model representations in kernel-based learning
This paper discusses the role of primal and (Lagrange) dual model representations in problems of supervised and unsupervised learning. The specification of the estimation problem is conceived at the primal level as a constrained optimization problem. The constraints relate to the model which is expressed in terms of the feature map. From the conditions for optimality one jointly finds the optimal model representation and the model estimate. At the dual level the model is expressed in terms of a positive definite kernel function, which is characteristic for a support vector machine methodology. It is discussed how least squares support vector machines are playing a central role as core models across problems of regression, classification, principal component analysis, spectral clustering, canonical correlation analysis, dimensionality reduction and data visualization.
Statist. Surv. Volume 4 (2010), 148-183.
First available in Project Euclid: 25 August 2010
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Kernel methods support vector machines constrained optimization primal and dual problem feature map regression classification principal component analysis spectral clustering canonical correlation analysis independence dimensionality reduction and data visualization sparseness robustness
Suykens, Johan A.K.; Alzate, Carlos; Pelckmans, Kristiaan. Primal and dual model representations in kernel-based learning. Statist. Surv. 4 (2010), 148--183. doi:10.1214/09-SS052. http://projecteuclid.org/euclid.ssu/1282746475.