The Annals of Statistics

Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components

Deborah J. Donnell, Andreas Buja, and Werner Stuetzle

Full-text: Open access

Abstract

Additive principal components are a nonlinear generalization of linear principal components. Their distinguishing feature is that linear forms $\sum_ia_i X_i$ are replaced with additive functions $\sum_i\phi_i(X_i)$. A considerable amount of flexibility for fitting data is gained when linear methods are replaced with additive ones. Our interest is in the smallest principal components, which is somewhat uncommon. Smallest additive principal components amount to data descriptions in terms of approximate implicit equations: $\sum_i\phi_i(X_i) \approx 0$. Estimation of such equations is a data-analytic method in its own right, competing in some cases with the more customary regression approaches. It is also a diagnostic tool in additive regression for detection of so-called "concurvity." This term describes degeneracies among predictor variables in additive regression models, similar to collinearity in linear regression models. Concurvity may lead to statistically unstable contributions of variables to additive models. As an example, we show in a reanalysis of the ozone data from Breiman and Friedman that concurvity does indeed exist in this particular data, a fact which may impact the interpretation of the additive fits. In the second half of this paper, we give some second-order theory, including the description of null situations and eigenexpansions derived from associated eigenproblems. We show how ACE and additive principal components are related, and we outline some analytical methods for theoretical calculations of additive principal components. Lastly we consider methods of estimation and computation. Additive principal components have had a long tradition in psychometric research and correspondence analysis. They have started receiving attention by statisticians only in recent years.

Article information

Source
Ann. Statist., Volume 22, Number 4 (1994), 1635-1668.

Dates
First available in Project Euclid: 11 April 2007

Permanent link to this document
https://projecteuclid.org/euclid.aos/1176325746

Digital Object Identifier
doi:10.1214/aos/1176325746

Mathematical Reviews number (MathSciNet)
MR1329164

Zentralblatt MATH identifier
0824.62050

JSTOR
links.jstor.org

Subjects
Primary: 62H25: Factor analysis and principal components; correspondence analysis
Secondary: 62G07: Density estimation

Keywords
Additive models nonlinear multivariate analysis multiple correspondence analysis scaling nonlinear transformations horseshoe effect

Citation

Donnell, Deborah J.; Buja, Andreas; Stuetzle, Werner. Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components. Ann. Statist. 22 (1994), no. 4, 1635--1668. doi:10.1214/aos/1176325746. https://projecteuclid.org/euclid.aos/1176325746


Export citation