The Annals of Statistics
- Ann. Statist.
- Volume 41, Number 1 (2013), 221-249.
A general theory for nonlinear sufficient dimension reduction: Formulation and estimation
In this paper we introduce a general theory for nonlinear sufficient dimension reduction, and explore its ramifications and scope. This theory subsumes recent work employing reproducing kernel Hilbert spaces, and reveals many parallels between linear and nonlinear sufficient dimension reduction. Using these parallels we analyze the properties of existing methods and develop new ones. We begin by characterizing dimension reduction at the general level of $\sigma$-fields and proceed to that of classes of functions, leading to the notions of sufficient, complete and central dimension reduction classes. We show that, when it exists, the complete and sufficient class coincides with the central class, and can be unbiasedly and exhaustively estimated by a generalized sliced inverse regression estimator (GSIR). When completeness does not hold, this estimator captures only part of the central class. However, in these cases we show that a generalized sliced average variance estimator (GSAVE) can capture a larger portion of the class. Both estimators require no numerical optimization because they can be computed by spectral decomposition of linear operators. Finally, we compare our estimators with existing methods by simulation and on actual data sets.
Ann. Statist., Volume 41, Number 1 (2013), 221-249.
First available in Project Euclid: 26 March 2013
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Dimension reduction $\sigma$-field exhaustivenes generalized sliced average variance estimator generalized sliced inverse regression estimator heteroscedastic conditional covariance operator sufficient and complete dimension reduction classes unbiasedness
Lee, Kuang-Yao; Li, Bing; Chiaromonte, Francesca. A general theory for nonlinear sufficient dimension reduction: Formulation and estimation. Ann. Statist. 41 (2013), no. 1, 221--249. doi:10.1214/12-AOS1071. https://projecteuclid.org/euclid.aos/1364302741
- Supplementary material: Supplement to “A general theory for nonlinear sufficient dimension reduction: Formulation and estimation”. This is supplementary appendix that contains some techincal proofs of the results in the paper.