Open Access
Translator Disclaimer
December, 1994 Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components
Deborah J. Donnell, Andreas Buja, Werner Stuetzle
Ann. Statist. 22(4): 1635-1668 (December, 1994). DOI: 10.1214/aos/1176325746


Additive principal components are a nonlinear generalization of linear principal components. Their distinguishing feature is that linear forms $\sum_ia_i X_i$ are replaced with additive functions $\sum_i\phi_i(X_i)$. A considerable amount of flexibility for fitting data is gained when linear methods are replaced with additive ones. Our interest is in the smallest principal components, which is somewhat uncommon. Smallest additive principal components amount to data descriptions in terms of approximate implicit equations: $\sum_i\phi_i(X_i) \approx 0$. Estimation of such equations is a data-analytic method in its own right, competing in some cases with the more customary regression approaches. It is also a diagnostic tool in additive regression for detection of so-called "concurvity." This term describes degeneracies among predictor variables in additive regression models, similar to collinearity in linear regression models. Concurvity may lead to statistically unstable contributions of variables to additive models. As an example, we show in a reanalysis of the ozone data from Breiman and Friedman that concurvity does indeed exist in this particular data, a fact which may impact the interpretation of the additive fits. In the second half of this paper, we give some second-order theory, including the description of null situations and eigenexpansions derived from associated eigenproblems. We show how ACE and additive principal components are related, and we outline some analytical methods for theoretical calculations of additive principal components. Lastly we consider methods of estimation and computation. Additive principal components have had a long tradition in psychometric research and correspondence analysis. They have started receiving attention by statisticians only in recent years.


Download Citation

Deborah J. Donnell. Andreas Buja. Werner Stuetzle. "Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components." Ann. Statist. 22 (4) 1635 - 1668, December, 1994.


Published: December, 1994
First available in Project Euclid: 11 April 2007

zbMATH: 0824.62050
MathSciNet: MR1329164
Digital Object Identifier: 10.1214/aos/1176325746

Primary: 62H25
Secondary: 62G07

Keywords: Additive models , horseshoe effect , multiple correspondence analysis , nonlinear multivariate analysis , nonlinear transformations , scaling

Rights: Copyright © 1994 Institute of Mathematical Statistics


Vol.22 • No. 4 • December, 1994
Back to Top