Annales de l'Institut Henri Poincaré, Probabilités et Statistiques

Optimal nonlinear transformations of random variables

Aldo Goia and Ernesto Salinelli
Source: Ann. Inst. H. Poincaré Probab. Statist. Volume 46, Number 3 (2010), 653-676.

Abstract

In this paper we deepen the study of the nonlinear principal components introduced by Salinelli in 1998, referring to a real random variable. New insights on their probabilistic and statistical meaning are given with some properties. An estimation procedure based on spline functions, adapting to a statistical framework the classical Rayleigh–Ritz method, is introduced. Asymptotic properties of the estimator are proved, providing an upper bound for the rate of convergence under suitable mild conditions. Some applications to the goodness-of-fit test and the construction of bivariate distributions are proposed.

Résumé

Dans cet article nous étudions les composantes principales non linéaires définies par Salinelli en 1998, dans le cas d’une variable aléatoire réelle. La signification probabiliste et statistique est approfondie et des proprietés sont illustrées. Une procédure d’estimation basée sur les fonctions splines, qui adapte la méthode classique de Rayleigh–Ritz, est présentée. Des propriétés asymptotiques de cet estimateur sont établies, et on donne une borne pour la vitesse de convergence sous des conditions générales. Des applications aux tests d’ajustement et à la construction de distributions bivariées sont proposées.

First Page: Show Hide
Primary Subjects: 60E05
Secondary Subjects: 49J05, 47A75, 62G05, 62G10
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aihp/1281100394
Digital Object Identifier: doi:10.1214/09-AIHP326
Zentralblatt MATH identifier: 05795079
Mathematical Reviews number (MathSciNet): MR2682262

References

[1] F. Antoci. Some necessary and some sufficient conditions for the compactness of the embedding of weighted Sobolev spaces. Ric. Mat. LII (2003) 55–71.
Mathematical Reviews (MathSciNet): MR2091081
Zentralblatt MATH: 05058921
[2] G. Arfken. Mathematical Methods for Physicists. Academic Press, New York, 1966.
Mathematical Reviews (MathSciNet): MR205512
[3] D. Bosq. Modelization, nonparametric estimation and prediction for continuous time process. In Nonparametric Functional Estimation and Related Topics 509–529. G. Roussas, (Ed.). Nato, Asi Series. Kluwer Academic, Dordrecht, 1991.
Mathematical Reviews (MathSciNet): MR1154349
Zentralblatt MATH: 0737.62032
[4] P. Burman. Rates of convergence for the estimate of the optimal transformations of variables. Ann. Statist. 19 (1991) 702–723.
Mathematical Reviews (MathSciNet): MR1105840
Zentralblatt MATH: 0733.62054
Digital Object Identifier: doi:10.1214/aos/1176348116
Project Euclid: euclid.aos/1176348116
[5] P. Burman and K. W. Chen. Nonparametric estimation of a regression function. Ann. Statist. 17 (1989) 1567–1596.
Mathematical Reviews (MathSciNet): MR1026300
Zentralblatt MATH: 0744.62054
Digital Object Identifier: doi:10.1214/aos/1176347382
Project Euclid: euclid.aos/1176347382
[6] G. Buttazzo, M. Giaquinta and S. Hildebrandt. One-Dimensional Variational Problems. Oxford Lecture Series in Mathematics and Its Applications 15. Clarendon Press, New York, 1998.
Mathematical Reviews (MathSciNet): MR1694383
Zentralblatt MATH: 0915.49001
[7] T. Cacoullos. On upper and lower-bounds for the variance of a function of a random variable. Ann. Probab. 10 (1982) 799–809.
Mathematical Reviews (MathSciNet): MR659549
Zentralblatt MATH: 0492.60021
Digital Object Identifier: doi:10.1214/aop/1176993788
Project Euclid: euclid.aop/1176993788
[8] T. Cacoullos and V. Papathanasiou. On upper bounds for the variance of functions of random variables. Statist. Probab. Lett. 3 (1985) 175–184.
Mathematical Reviews (MathSciNet): MR801687
[9] T. Cacoullos and V. Papathanasiou. Characterizations of distributions by variance bounds. Statist. Probab. Lett. 7 (1989) 351–356.
Mathematical Reviews (MathSciNet): MR1001133
[10] T. Cacoullos and V. Papathanasiou. Characterization of distributions by generalizations of variance bounds and simple proofs of the CLT. J. Statist. Plann. Inference 63 (1997) 157–171.
Mathematical Reviews (MathSciNet): MR1491576
Zentralblatt MATH: 0922.62009
Digital Object Identifier: doi:10.1016/S0378-3758(97)00008-6
[11] H. Cardot. Spatially adaptive splines for statistical linear inverse problems. J. Multivariate Anal. 81 (2002) 100–119.
Mathematical Reviews (MathSciNet): MR1901208
Zentralblatt MATH: 1005.65053
Digital Object Identifier: doi:10.1006/jmva.2001.1994
[12] L. H. Y. Chen and J. H. Lou. Characterization of probability distributions by Poincaré-type inequalities. Ann. Inst. H. Poincaré Probab. Statist 23 (1987) 91–110.
Mathematical Reviews (MathSciNet): MR877386
[13] H. Chernoff. A note on an inequality involving the normal distribution. Ann. Probab. 9 (1981) 533–535.
Mathematical Reviews (MathSciNet): MR614640
Zentralblatt MATH: 0457.60014
Digital Object Identifier: doi:10.1214/aop/1176994428
Project Euclid: euclid.aop/1176994428
[14] R. Courant and D. Hilbert. Methods of Mathematical Physics. Wiley, New York, 1989.
Mathematical Reviews (MathSciNet): MR1013360
[15] J. Dauxois, A. Pousse and Y. Romain. Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference. J. Multivariate Anal. 12 (1982) 136–154.
Mathematical Reviews (MathSciNet): MR650934
Zentralblatt MATH: 0539.62064
Digital Object Identifier: doi:10.1016/0047-259X(82)90088-4
[16] C. De Boor. A Practical Guide to Splines. Springer, New York, 2001.
Mathematical Reviews (MathSciNet): MR1900298
[17] N. E. El Faouzi and P. Sarda. Rates of convergence for spline estimates of additive principal components. J. Multivariate Anal. 68 (1999) 120–137.
Mathematical Reviews (MathSciNet): MR1668907
Zentralblatt MATH: 0927.62061
Digital Object Identifier: doi:10.1006/jmva.1998.1781
[18] I. M. Gelfand and S. V. Fomin. Calculus of Variations. Prentice-Hall, New Jersey, 1963.
Mathematical Reviews (MathSciNet): MR160139
[19] P. Gurka and B. Opic. Continuous and compact imbeddings of weighted Sobolev Spaces II. Czechoslovak Math. J. 39 (1989) 78–94.
Mathematical Reviews (MathSciNet): MR983485
[20] C. A. J. Klaassen. On an inequality of Chernoff. Ann. Probab. 13 (1985) 966–974.
Mathematical Reviews (MathSciNet): MR799431
Zentralblatt MATH: 0576.60015
Digital Object Identifier: doi:10.1214/aop/1176992917
Project Euclid: euclid.aop/1176992917
[21] A. Kufner and B. Opic. How to define reasonably weighted Sobolev Spaces. Comment. Math. Univ. Carolin. 25 (1984) 537–554.
Mathematical Reviews (MathSciNet): MR775568
Zentralblatt MATH: 0557.46025
[22] O. Johnson and A. Barron. Fisher information inequalities and the central limit theorem, Probab. Theory Related Fields 129 (2004) 391–409.
Mathematical Reviews (MathSciNet): MR2128239
Zentralblatt MATH: 1047.62005
Digital Object Identifier: doi:10.1007/s00440-004-0344-0
[23] I. T. Jolliffe. Principal Component Analysis. Springer, Berlin, 2004.
Mathematical Reviews (MathSciNet): MR841268
[24] H. O. Lancaster. The Chi-Squared Distribution. Wiley, New York, 1969.
Mathematical Reviews (MathSciNet): MR253452
Zentralblatt MATH: 0193.17802
[25] M.-L. T. Lee. Properties and applications of the Samarov family of bivariate distributions. Comm. Statist. Theory Methods 25 (1996) 1207–1222.
Mathematical Reviews (MathSciNet): MR1394279
Zentralblatt MATH: 0875.62205
Digital Object Identifier: doi:10.1080/03610929608831759
[26] D. D. Mari and S. Kotz. Correlation and Dependence. Imperial College Press, London, 2001.
Mathematical Reviews (MathSciNet): MR1835042
Zentralblatt MATH: 0977.62004
[27] M. Okamoto. Distinctness of the eigenvalues of a quadratic form in a multivariate sample. Ann. Statist. 1 (1973) 763–765.
Mathematical Reviews (MathSciNet): MR331643
Zentralblatt MATH: 0261.62043
Digital Object Identifier: doi:10.1214/aos/1176342472
Project Euclid: euclid.aos/1176342472
[28] J. G. Pierce and R. S. Varga. Higher order convergence results for the Rayleigh–Ritz method applied to eigenvalue problems. I: Estimates relating Rayleigh–Ritz and Galerkin approximations to eigenfunctions. SIAM J. Numer. Anal. 9 (1972) 137–151.
Mathematical Reviews (MathSciNet): MR395268
Zentralblatt MATH: 0301.65063
Digital Object Identifier: doi:10.1137/0709014
[29] S. Purkayastha and S. K. Bhandari. Characterization of uniform distributions by inequality of Chernoff-type, Sankhyā 52 (1990) 376–382.
Mathematical Reviews (MathSciNet): MR1178045
[30] E. Salinelli. Nonlinear principal components I. Absolutely continuous random variables with positive bounded densities. Ann. Statist. 26 (1998) 596–616.
Mathematical Reviews (MathSciNet): MR1626079
Zentralblatt MATH: 0929.62067
Digital Object Identifier: doi:10.1214/aos/1028144850
Project Euclid: euclid.aos/1028144850
[31] E. Salinelli. Nonlinear principal components II. Characterization of normal distributions. J. Multivariate Anal. 100 (2009) 652–660.
Mathematical Reviews (MathSciNet): MR2478188
Zentralblatt MATH: 1169.62058
Digital Object Identifier: doi:10.1016/j.jmva.2008.07.001
[32] L. L. Schumaker. Spline Functions: Basic Theory. Wiley, New York, 1981.
Mathematical Reviews (MathSciNet): MR606200
[33] C. J. Stone. Optimal global rate of convergence for nonparametric regression. Ann. Statist. 10 (1982) 1040–1053.
Mathematical Reviews (MathSciNet): MR673642
Zentralblatt MATH: 0511.62048
Digital Object Identifier: doi:10.1214/aos/1176345969
Project Euclid: euclid.aos/1176345969
[34] A. Zettl. Sturm–Liouville Theory. Mathematical Survey and Monographs 121. Amer. Math. Soc., Providence, RI, 2005.
Mathematical Reviews (MathSciNet): MR2170950

2012 © Institut Henri Poincaré

Annales de l'Institut Henri Poincaré, Probabilités et Statistiques

Annales de l'Institut Henri Poincaré, Probabilités et Statistiques