Quadratic distances on probabilities: A unified foundation



The Annals of Statistics

Quadratic distances on probabilities: A unified foundation

Bruce G. Lindsay, Marianthi Markatou, Surajit Ray, Ke Yang, and Shu-Chuan Chen

Source: Ann. Statist. Volume 36, Number 2 (2008), 983-1006.

Abstract

This work builds a unified framework for the study of quadratic form distance measures as they are used in assessing the goodness of fit of models. Many important procedures have this structure, but the theory for these methods is dispersed and incomplete. Central to the statistical analysis of these distances is the spectral decomposition of the kernel that generates the distance. We show how this determines the limiting distribution of natural goodness-of-fit tests. Additionally, we develop a new notion, the spectral degrees of freedom of the test, based on this decomposition. The degrees of freedom are easy to compute and estimate, and can be used as a guide in the construction of useful procedures in this class.

Primary Subjects: 62A01, 62E20
Secondary Subjects: 62H10
Keywords: Degrees of freedom; diffusion kernel; goodness of fit; high dimensions; model assessment; quadratic distance; spectral decomposition

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Alternatively, the document is available for a cost of $15. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1205420526
Digital Object Identifier: doi:10.1214/009053607000000956
Mathematical Reviews number (MathSciNet): MR2396822

References

Axler, S., Bourdon, P. and Ramey, W. (2001). Harmonic Function Theory, 2nd ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR1805196
Zentralblatt MATH: 0959.31001
Bhatia, R. (2003). Fourier Series. Reprint of the 1993 edition [Hindustan Book Agency, New Delhi]. Classroom Resource Materials Series. Mathematical Association of America, Washington, DC.
Mathematical Reviews (MathSciNet): MR1657675
Zentralblatt MATH: 0940.42001
Fan, J., Zhang, C. and Zhang, J. (2001). Generalized likelihood ratio statistics and Wilks phenomenon. Ann. Statist. 29 153–193.
Mathematical Reviews (MathSciNet): MR1833962
Digital Object Identifier: doi:10.1214/aos/996986505
Project Euclid: euclid.aos/996986505
Fan, J. (1996). Test of significance based on wavelet thresholding and Neyman’s truncation. J. Amer. Statist. Assoc. 91 674–688.
Mathematical Reviews (MathSciNet): MR1395735
Digital Object Identifier: doi:10.2307/2291663
Fan, Y. (1997). Goodness-of-fit tests for a multivariate distribution by the empirical characteristic function. J. Multivariate Anal. 62 36–63.
Mathematical Reviews (MathSciNet): MR1467872
Digital Object Identifier: doi:10.1006/jmva.1997.1672
Fan, Y. (1998). Goodness-of-fit tests based on kernel density estimators with fixed smoothing parameters. Econometric Theory 14 604–621.
Mathematical Reviews (MathSciNet): MR1651463
Digital Object Identifier: doi:10.1017/S0266466698145036
Hastie, T., Tibshirani, R. and Friedman, J. H. (2001). The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer, New York.
Mathematical Reviews (MathSciNet): MR1851606
Zentralblatt MATH: 0973.62007
Lévy, P. (1939). L’addition des variable aleatoires defines sur une circonference. Bull. Soc. Math. France 67 1–41.
Lindsay, B. G., Kettenring, J. and Siegmund, D. O. (2004). A report on the future of statistics (with discussion). Statist. Sci. 19 387–413.
Mathematical Reviews (MathSciNet): MR2185624
Digital Object Identifier: doi:10.1214/088342304000000404
Project Euclid: euclid.ss/1110999308
Lindsay, B. G. and Markatou, M. (2002). Statistical Distances: A Global Framework to Inference. Springer, New York. To appear.
Liu, Z. J. and Rao, C. R. (1995). Asymptotic distribution of statistics based on quadratic entropy and bootstrapping. J. Statist. Plann. Inference 43 1–18.
Mathematical Reviews (MathSciNet): MR1314125
Digital Object Identifier: doi:10.1016/0378-3758(94)00005-G
Satterthwaite, F. W. (1946). An approximate distribution of estimates of variance components. Biometrics Bull. 2 110–114.
Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR595165
Zentralblatt MATH: 0538.62002
Silverman, B. W. (1986). Density Estimation for Statistics and Data Analysis. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR848134
Zentralblatt MATH: 0617.62042
Spitzner, D. J. (2006). Use of goodness-of-fit procedures in high dimensional testing. J. Statist. Comput. Simul. 76 447–457.
Mathematical Reviews (MathSciNet): MR2224364
Digital Object Identifier: doi:10.1080/10629360500107907
Thangavelu, S. (1993). Lectures on Hermite and Laguerre Expansions. Princeton Univ. Press.
Mathematical Reviews (MathSciNet): MR1215939
Zentralblatt MATH: 0791.41030
Wintner, A. (1947). On the shape of the angular case of Cauchy’s distribution curves. Ann. Math. Statist. 18 589–593.
Mathematical Reviews (MathSciNet): MR22620
Digital Object Identifier: doi:10.1214/aoms/1177730351
Project Euclid: euclid.aoms/1177730351
Yang, K. (2004). Using the Poisson kernel in model building and selection. Ph.D. dissertation, Pennsylvania State Univ.
Yosida, K. (1980). Functional Analysis, 6th ed. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR617913
Zentralblatt MATH: 0435.46002
Zuo, Y. and He, X. (2006). On the limiting distributions of multivariate depth-based rank sum statistics and related tests. Ann. Statist. 34 2879–2896.
Mathematical Reviews (MathSciNet): MR2329471
Digital Object Identifier: doi:10.1214/009053606000000876
Project Euclid: euclid.aos/1179935068

2008 © Institute of Mathematical Statistics