Open Access
October 2003 Ridgelets: estimating with ridge functions
Emmanuel J. Candès
Ann. Statist. 31(5): 1561-1599 (October 2003). DOI: 10.1214/aos/1065705119

Abstract

Feedforward neural networks, projection pursuit regression, and more generally, estimation via ridge functions have been proposed as an approach to bypass the curse of dimensionality and are now becoming widely applied to approximation or prediction in applied sciences. To address problems inherent to these methods--ranging from the construction of neural networks to their efficiency and capability--Candès [Appl. Comput. armon. Anal. 6 (1999) 197-218] developed a new system that allows the representation of arbitrary functions as superpositions of specific ridge functions, the ridgelets.

In a nonparametric regression setting, this article suggests expanding noisy data into a ridgelet series and applying a scalar nonlinearity to the coefficients (damping); this is unlike existing approaches based on stepwise additions of elements. The procedure is simple, constructive, stable and spatially adaptive--and fast algorithms have been developed to implement it.

The ridgelet estimator is nearly optimal for estimating functions with certain kinds of spatial inhomogeneities. In addition, ridgelets help to identify new classes of estimands--corresponding to a new notion of smoothness--that are well suited for ridge functions estimation. While the results are stated in a decision theoretic framework, numerical experiments are also presented to illustrate the practical performance of the methodology.

Citation

Download Citation

Emmanuel J. Candès. "Ridgelets: estimating with ridge functions." Ann. Statist. 31 (5) 1561 - 1599, October 2003. https://doi.org/10.1214/aos/1065705119

Information

Published: October 2003
First available in Project Euclid: 9 October 2003

zbMATH: 1046.62037
MathSciNet: MR2012826
Digital Object Identifier: 10.1214/aos/1065705119

Subjects:
Primary: 62C20 , 62G07
Secondary: 41A30

Keywords: edges , minimax decision theory , Nonparametric regression , Projection pursuit regression , Radon transform , ridge functions , ridgelets , spatial inhomogeneities , thresholding of ridgelet coefficients

Rights: Copyright © 2003 Institute of Mathematical Statistics

Vol.31 • No. 5 • October 2003
Back to Top