The Annals of Statistics

On surrogate dimension reduction for measurement error regression: An invariance law

Bing Li and Xiangrong Yin

Source: Ann. Statist. Volume 35, Number 5 (2007), 2143-2172.

Abstract

We consider a general nonlinear regression problem where the predictors contain measurement error. It has been recently discovered that several well-known dimension reduction methods, such as OLS, SIR and pHd, can be performed on the surrogate regression problem to produce consistent estimates for the original regression problem involving the unobserved true predictor. In this paper we establish a general invariance law between the surrogate and the original dimension reduction spaces, which implies that, at least at the population level, the two dimension reduction problems are in fact equivalent. Consequently we can apply all existing dimension reduction methods to measurement error regression problems. The equivalence holds exactly for multivariate normal predictors, and approximately for arbitrary predictors. We also characterize the rate of convergence for the surrogate dimension reduction estimators. Finally, we apply several dimension reduction methods to real and simulated data sets involving measurement error to compare their performances.

Primary Subjects: 62G08, 62H12
Keywords: Central spaces; central mean space; invariance; regression graphics; surrogate predictors and response; weak convergence in probability

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1194461725
Digital Object Identifier: doi:10.1214/009053607000000172
Mathematical Reviews number (MathSciNet): MR2363966
Zentralblatt MATH identifier: 1126.62055

References

Billingsley, P. (1968). Convergence of Probability Measures. Wiley, New York.
Mathematical Reviews (MathSciNet): MR0233396
Zentralblatt MATH: 0172.21201
Carroll, R. J. (1989). Covariance analysis in generalized linear measurement error models. Stat. Med. 8 1075--1093.
Carroll, R. J. and Li, K.-C. (1992). Measurement error regression with unknown link: Dimension reduction and data visualization. J. Amer. Statist. Assoc. 87 1040--1050.
Mathematical Reviews (MathSciNet): MR1209565
Digital Object Identifier: doi:10.2307/2290641
Carroll, R. J., Ruppert, D. and Stefanski, L. A. (1995). Measurement Error in Nonlinear Models. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1630517
Zentralblatt MATH: 0853.62048
Carroll, R. J. and Stefanski, L. A. (1990). Approximate quasi-likelihood estimation in models with surrogate predictors. J. Amer. Statist. Assoc. 85 652--663.
Mathematical Reviews (MathSciNet): MR1138349
Digital Object Identifier: doi:10.2307/2290000
Cook, R. D. (1994). Using dimension-reduction subspaces to identify important inputs in models of physical systems. In ASA Proc. Section on Physical and Engineering Sciences 18--25. Amer. Statist. Assoc., Alexandria, VA.
Cook, R. D. (1998). Regression Graphics: Ideas for Studying Regressions Through Graphics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1645673
Zentralblatt MATH: 0903.62001
Cook, R. D. (2007). Fisher lecture: Dimension reduction in regression. Statist. Sci. 22 1--26.
Cook, R. D. and Li, B. (2002). Dimension reduction for the conditional mean in regression. Ann. Statist. 30 455--474.
Mathematical Reviews (MathSciNet): MR1902895
Digital Object Identifier: doi:10.1214/aos/1021379861
Project Euclid: euclid.aos/1021379861
Cook, R. D. and Li, B. (2004). Determining the dimension of iterative Hessian transformation. Ann. Statist. 32 2501--2531.
Mathematical Reviews (MathSciNet): MR2153993
Digital Object Identifier: doi:10.1214/009053604000000661
Project Euclid: euclid.aos/1107794877
Cook, R. D. and Weisberg, S. (1991). Discussion of ``Sliced inverse regression for dimension reduction,'' by K.-C. Li. J. Amer. Statist. Assoc. 86 328--332.
Mathematical Reviews (MathSciNet): MR1137117
Digital Object Identifier: doi:10.2307/2290563
Diaconis, P. and Freedman, D. (1984). Asymptotics of graphical projection pursuit. Ann. Statist. 12 793--815.
Mathematical Reviews (MathSciNet): MR0751274
Digital Object Identifier: doi:10.1214/aos/1176346703
Project Euclid: euclid.aos/1176346703
Duan, N. and Li, K.-C. (1991). Slicing regression: A link-free regression method. Ann. Statist. 19 505--530.
Mathematical Reviews (MathSciNet): MR1105834
Digital Object Identifier: doi:10.1214/aos/1176348109
Project Euclid: euclid.aos/1176348109
Fernholz, L. T. (1983). von Mises Calculus for Statistical Functionals. Lecture Notes in Statist. 19. Springer, New York.
Mathematical Reviews (MathSciNet): MR0713611
Zentralblatt MATH: 0525.62031
Fuller, W. A. (1987). Measurement Error Models. Wiley, New York.
Mathematical Reviews (MathSciNet): MR0898653
Zentralblatt MATH: 0800.62413
Fung, W. K., He, X., Liu, L. and Shi, P. (2002). Dimension reduction based on canonical correlation. Statist. Sinica 12 1093--1113.
Mathematical Reviews (MathSciNet): MR1947065
Zentralblatt MATH: 1004.62058
Hall, P. and Li, K.-C. (1993). On almost linearity of low-dimensional projections from high-dimensional data. Ann. Statist. 21 867--889.
Mathematical Reviews (MathSciNet): MR1232523
Digital Object Identifier: doi:10.1214/aos/1176349155
Project Euclid: euclid.aos/1176349155
Li, B., Zha, H. and Chiaromonte, F. (2005). Contour regression: A general approach to dimension reduction. Ann. Statist. 33 1580--1616.
Mathematical Reviews (MathSciNet): MR2166556
Digital Object Identifier: doi:10.1214/009053605000000192
Project Euclid: euclid.aos/1123250223
Li, K.-C. (1991). Sliced inverse regression for dimension reduction (with discussion). J. Amer. Statist. Assoc. 86 316--342.
Mathematical Reviews (MathSciNet): MR1137117
Digital Object Identifier: doi:10.2307/2290563
Li, K.-C. (1992). On principal Hessian directions for data visualization and dimension reduction: Another application of Stein's lemma. J. Amer. Statist. Assoc. 87 1025--1039.
Mathematical Reviews (MathSciNet): MR1209564
Digital Object Identifier: doi:10.2307/2290640
Li, K.-C. and Duan, N. (1989). Regression analysis under link violation. Ann. Statist. 17 1009--1052.
Mathematical Reviews (MathSciNet): MR1015136
Digital Object Identifier: doi:10.1214/aos/1176347254
Project Euclid: euclid.aos/1176347254
Lue, H.-H. (2004). Principal Hessian directions for regression with measurement error. Biometrika 91 409--423.
Mathematical Reviews (MathSciNet): MR2081310
Zentralblatt MATH: 1079.62066
Digital Object Identifier: doi:10.1093/biomet/91.2.409
Pepe, M. S. and Fleming, T. R. (1991). A nonparametric method for dealing with mismeasured covariate data. J. Amer. Statist. Assoc. 86 108--113.
Mathematical Reviews (MathSciNet): MR1137103
Digital Object Identifier: doi:10.2307/2289720
Warren, R. D., White, J. K. and Fuller, W. A. (1974). An errors-in-variables analysis of managerial role performance. J. Amer. Statist. Assoc. 69 886--893.
Xia, Y., Tong, H., Li, W. K. and Zhu, L.-X. (2002). An adaptive estimation of dimension reduction space. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 363--410.
Mathematical Reviews (MathSciNet): MR1924297
Digital Object Identifier: doi:10.1111/1467-9868.03411
Yin, X. and Cook, R. D. (2002). Dimension reduction for the conditional $k$-th moment in regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 159--175.
Mathematical Reviews (MathSciNet): MR1904698
Digital Object Identifier: doi:10.1111/1467-9868.00330
Yin, X. and Cook, R. D. (2003). Estimating central subspaces via inverse third moments. Biometrika 90 113--125.
Mathematical Reviews (MathSciNet): MR1966554
Zentralblatt MATH: 1035.62051
Digital Object Identifier: doi:10.1093/biomet/90.1.113
Yin, X. and Cook, R. D. (2004). Dimension reduction via marginal fourth moments in regression. J. Comput. Graph. Statist. 13 554--570.
Mathematical Reviews (MathSciNet): MR2087714
Digital Object Identifier: doi:10.1198/106186004X2462

2009 © Institute of Mathematical Statistics