The Annals of Statistics

Local linear spatial regression

Marc Hallin, Zudi Lu, and Lanh T. Tran
Source: Ann. Statist. Volume 32, Number 6 (2004), 2469-2500.

Abstract

A local linear kernel estimator of the regression function xg(x):=E[Yi|Xi=x], x∈ℝd, of a stationary (d+1)-dimensional spatial process {(Y i,Xi),i∈ℤN} observed over a rectangular domain of the form ℐn:={i=(i1,…,iN)∈ℤN|1≤iknk,k=1,…,N}, n=(n1,…,nN)∈ℤN, is proposed and investigated. Under mild regularity assumptions, asymptotic normality of the estimators of g(x) and its derivatives is established. Appropriate choices of the bandwidths are proposed. The spatial process is assumed to satisfy some very general mixing conditions, generalizing classical time-series strong mixing concepts. The size of the rectangular domain ℐn is allowed to tend to infinity at different rates depending on the direction in ℤN.

First Page: Show Hide
Primary Subjects: 62G05
Secondary Subjects: 60J25, 62J02
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1107794876
Digital Object Identifier: doi:10.1214/009053604000000850
Mathematical Reviews number (MathSciNet): MR2153992
Zentralblatt MATH identifier: 1069.62075

References

Anselin, L. and Florax, R. J. G. M. (1995). New Directions in Spatial Econometrics. Springer, Berlin.
Zentralblatt MATH: 0826.00018
Besag, J. E. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Roy. Statist. Soc. Ser. B 36 192--236.
Mathematical Reviews (MathSciNet): MR373208
Biau, G. (2003). Spatial kernel density estimation. Math. Methods Statist. 12 371--390.
Mathematical Reviews (MathSciNet): MR2054154
Biau, G. and Cadre, B. (2004). Nonparametric spatial prediction. Stat. Inference Stoch. Process. 7 327--349.
Mathematical Reviews (MathSciNet): MR2111294
Digital Object Identifier: doi:10.1023/B:SISP.0000049116.23705.88
Zentralblatt MATH: 1125.62317
Boente, G. and Fraiman, R. (1988). Consistency of a nonparametric estimate of a density function for dependent variables. J. Multivariate Anal. 25 90--99.
Mathematical Reviews (MathSciNet): MR935296
Digital Object Identifier: doi:10.1016/0047-259X(88)90154-6
Zentralblatt MATH: 0664.62038
Bolthausen, E. (1982). On the central limit theorem for stationary mixing random fields. Ann. Probab. 10 1047--1050.
Mathematical Reviews (MathSciNet): MR672305
Bosq, D. (1989). Estimation et prévision nonparamétrique d'un processus stationnaire. C. R. Acad. Sci. Paris Sér. I Math. 308 453--456.
Mathematical Reviews (MathSciNet): MR991881
Bradley, R. C. and Tran, L. T. (1999). Density estimation for nonisotropic random fields. J. Statist. Plann. Inference 81 51--70.
Mathematical Reviews (MathSciNet): MR1718397
Digital Object Identifier: doi:10.1016/S0378-3758(99)00011-7
Zentralblatt MATH: 0954.62112
Carbon, M., Hallin, M. and Tran, L. T. (1996). Kernel density estimation for random fields: The $L_1$ theory. J. Nonparametr. Statist. 6 157--170.
Mathematical Reviews (MathSciNet): MR1383049
Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots. J. Amer. Statist. Assoc. 74 829--836.
Mathematical Reviews (MathSciNet): MR556476
Cleveland, W. S. and Loader, C. (1996). Smoothing by local regression: Principles and methods. In Statistical Theory and Computational Aspects of Smoothing (W. Härdle and M. G. Schimek, eds.) 10--49. Physica, Heidelberg.
Mathematical Reviews (MathSciNet): MR1482831
Cressie, N. A. C. (1991). Statistics for Spatial Data. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1127423
Zentralblatt MATH: 0799.62002
Deo, C. M. (1973). A note on empirical processes of strong mixing sequences. Ann. Probab. 1 870--875.
Mathematical Reviews (MathSciNet): MR356160
Digital Object Identifier: doi:10.1214/aop/1176996855
Devroye, L. and Györfi, L. (1985). Nonparametric Density Estimation: The $L_1$ View. Wiley, New York.
Mathematical Reviews (MathSciNet): MR780746
Zentralblatt MATH: 0546.62015
Fan, J. (1992). Design-adaptive nonparametric regression. \JASA 87 998--1004.
Mathematical Reviews (MathSciNet): MR1209561
Fan, J. and Gijbels, I. (1992). Variable bandwidth and local linear regression smoothers. Ann. Statist. 20 2008--2036.
Mathematical Reviews (MathSciNet): MR1193323
Fan, J. and Gijbels, I. (1995). Data-driven bandwidth selection in local polynomial fitting: Variable bandwidth and spatial adaptation. J. Roy. Statist. Soc. Ser. B 57 371--394.
Mathematical Reviews (MathSciNet): MR1323345
Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1383587
Zentralblatt MATH: 0873.62037
Fan, J. and Yao, Q. (2003). Nonlinear Time Series: Nonparametric and Parametric Methods. Springer, New York.
Mathematical Reviews (MathSciNet): MR1964455
Zentralblatt MATH: 1014.62103
Guyon, X. (1987). Estimation d'un champ par pseudo-vraisemblance conditionnelle: Étude asymptotique et application au cas Markovien. In Spatial Processes and Spatial Time Series Analysis. Proc. 6th Franco--Belgian Meeting of Statisticians (J.-J. Droesbeke et al., eds.) 15--62. FUSL, Brussels.
Mathematical Reviews (MathSciNet): MR947996
Guyon, X. (1995). Random Fields on a Network. Springer, New York.
Mathematical Reviews (MathSciNet): MR1344683
Zentralblatt MATH: 0839.60003
Györfi, L., Härdle, W., Sarda, P. and Vieu, P. (1989). Nonparametric Curve Estimation From Time Series. Lecture Notes in Statist. 60. Springer, New York.
Mathematical Reviews (MathSciNet): MR1027837
Hallin, M., Lu, Z. and Tran, L. T. (2001). Density estimation for spatial linear processes. Bernoulli 7 657--668.
Mathematical Reviews (MathSciNet): MR1849373
Project Euclid: euclid.bj/1079559468
Hallin, M., Lu, Z. and Tran, L. T. (2004). Density estimation for spatial processes: The $L_1$ theory. J. Multivariate Anal. 88 61--75.
Mathematical Reviews (MathSciNet): MR2021860
Digital Object Identifier: doi:10.1016/S0047-259X(03)00060-5
Zentralblatt MATH: 1032.62033
Hallin, M. and Tran, L. T. (1996). Kernel density estimation for linear processes: Asymptotic normality and optimal bandwidth derivation. \AISM 48 429--449.
Mathematical Reviews (MathSciNet): MR1424774
Digital Object Identifier: doi:10.1007/BF00050847
Zentralblatt MATH: 0886.62042
Hastie, T. and Loader, C. (1993). Local regression: Automatic kernel carpentry (with discussion). Statist. Sci. 8 120--143.
Ibragimov, I. A. and Linnik, Yu. V. (1971). Independent and Stationary Sequences of Random Variables. Wolters-Noordhoff, Groningen.
Mathematical Reviews (MathSciNet): MR322926
Zentralblatt MATH: 0219.60027
Ioannides, D. A. and Roussas, G. G. (1987). Note on the uniform convergence of density estimates for mixing random variables. Statist. Probab. Lett. 5 279--285.
Mathematical Reviews (MathSciNet): MR896459
Lu, Z. (1998). On geometric ergodicity of a non-linear autoregressive model with an autoregressive conditional heteroscedastic term. Statist. Sinica 8 1205--1217.
Mathematical Reviews (MathSciNet): MR1666249
Lu, Z. (2001). Asymptotic normality of kernel density estimators under dependence. \AISM 53 447--468.
Mathematical Reviews (MathSciNet): MR1868884
Digital Object Identifier: doi:10.1023/A:1014652626073
Zentralblatt MATH: 0989.62021
Lu, Z. and Chen, X. (2002). Spatial nonparametric regression estimation: Nonisotropic case. Acta Math. Appl. Sinica (English Ser.) 18 641--656.
Mathematical Reviews (MathSciNet): MR2012328
Digital Object Identifier: doi:10.1007/s102550200067
Zentralblatt MATH: 1019.62039
Lu, Z. and Chen, X. (2004). Spatial kernel regression estimation: Weak consistency. Statist. Probab. Lett. 68 125--136.
Mathematical Reviews (MathSciNet): MR2066167
Lu, Z. and Cheng, P. (1997). Distribution-free strong consistency for nonparametric kernel regression involving nonlinear time series. \JSPI 65 67--86.
Mathematical Reviews (MathSciNet): MR1619667
Digital Object Identifier: doi:10.1016/S0378-3758(97)00045-1
Zentralblatt MATH: 0907.62053
Masry, E. (1983). Probability density estimation from sampled data. IEEE Trans. Inform. Theory 29 696--709.
Mathematical Reviews (MathSciNet): MR730907
Digital Object Identifier: doi:10.1109/TIT.1983.1056736
Zentralblatt MATH: 0521.62031
Masry, E. (1986). Recursive probability density estimation for weakly dependent processes. IEEE Trans. Inform. Theory 32 254--267.
Mathematical Reviews (MathSciNet): MR838413
Digital Object Identifier: doi:10.1109/TIT.1986.1057163
Zentralblatt MATH: 0602.62028
Masry, E. and Fan, J. (1997). Local polynomial estimation of regression functions for mixing processes. Scand. J. Statist. 24 165--179.
Mathematical Reviews (MathSciNet): MR1455865
Digital Object Identifier: doi:10.1111/1467-9469.00056
Zentralblatt MATH: 0881.62047
Masry, E. and Györfi, L. (1987). Strong consistency and rates for recursive density estimators for stationary mixing processes. J. Multivariate Anal. 22 79--93.
Mathematical Reviews (MathSciNet): MR890884
Digital Object Identifier: doi:10.1016/0047-259X(87)90077-7
Zentralblatt MATH: 0619.62079
Masry, E. and Tjøstheim, D. (1995). Nonparametric estimation and identification of nonlinear ARCH time series: Strong consistency and asymptotic normality. Econometric Theory 11 258--289.
Mathematical Reviews (MathSciNet): MR1341250
Nakhapetyan, B. S. (1980). The central limit theorem for random fields with mixing conditions. In Multicomponent Random Systems (R. L. Dobrushin and Ya. G. Sinai, eds.) 531--548. Dekker, New York.
Mathematical Reviews (MathSciNet): MR599547
Zentralblatt MATH: 0442.60053
Nakhapetyan, B. S. (1987). An approach to proving limit theorems for dependent random variables. Theory Probab. Appl. 32 535--539.
Mathematical Reviews (MathSciNet): MR914955
Neaderhouser, C. C. (1980). Convergence of blocks spins defined by a random field. J. Statist. Phys. 22 673--684.
Mathematical Reviews (MathSciNet): MR579097
Digital Object Identifier: doi:10.1007/BF01013936
Pham, T. D. (1986). The mixing properties of bilinear and generalized random coefficient autoregressive models. Stochastic Process. Appl. 23 291--300.
Mathematical Reviews (MathSciNet): MR876051
Digital Object Identifier: doi:10.1016/0304-4149(86)90042-6
Zentralblatt MATH: 0614.60062
Pham, D. T. and Tran, L. T. (1985). Some mixing properties of time series models. Stochastic Process. Appl. 19 297--303.
Mathematical Reviews (MathSciNet): MR787587
Digital Object Identifier: doi:10.1016/0304-4149(85)90031-6
Zentralblatt MATH: 0564.62068
Possolo, A. (1991). Spatial Statistics and Imaging. IMS, Hayward, CA.
Mathematical Reviews (MathSciNet): MR1195556
Zentralblatt MATH: 0760.00005
Ripley, B. (1981). Spatial Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR624436
Zentralblatt MATH: 0583.62087
Robinson, P. M. (1983). Nonparametric estimators for time series. J. Time Ser. Anal. 4 185--207.
Mathematical Reviews (MathSciNet): MR732897
Robinson, P. M. (1987). Time series residuals with application to probability density estimation. J. Time Ser. Anal. 8 329--344.
Mathematical Reviews (MathSciNet): MR903762
Rosenblatt, M. (1985). Stationary Sequences and Random Fields. Birkhäuser, Boston.
Mathematical Reviews (MathSciNet): MR885090
Zentralblatt MATH: 0597.62095
Roussas, G. G. (1969). Nonparametric estimation of the transition distribution function of a Markov process. Ann. Math. Statist. 40 1386--1400.
Mathematical Reviews (MathSciNet): MR246471
Digital Object Identifier: doi:10.1214/aoms/1177697510
Roussas, G. G. (1988). Nonparametric estimation in mixing sequences of random variables. \JSPI 18 135--149.
Mathematical Reviews (MathSciNet): MR922204
Digital Object Identifier: doi:10.1016/0378-3758(88)90001-8
Ruppert, D. and Wand, M. P. (1994). Multivariate locally weighted least squares regression. \ANNALS 22 1346--1370.
Mathematical Reviews (MathSciNet): MR1311979
Stone, C. J. (1977). Consistent nonparametric regression (with discussion). \ANNALS 5 595--645.
Mathematical Reviews (MathSciNet): MR443204
Takahata, H. (1983). On the rates in the central limit theorem for weakly dependent random fields. Z. Wahrsch. Verw. Gebiete 64 445--456.
Mathematical Reviews (MathSciNet): MR717753
Tjøstheim, D. (1990). Nonlinear time series and Markov chains. Adv. in Appl. Probab. 22 587--611.
Mathematical Reviews (MathSciNet): MR1066965
Tran, L. T. (1989). The $L_1$ convergence of kernel density estimates under dependence. Canad. J. Statist. 17 197--208.
Mathematical Reviews (MathSciNet): MR1033102
Tran, L. T. (1990). Kernel density estimation on random fields. J. Multivariate Anal. 34 37--53.
Mathematical Reviews (MathSciNet): MR1062546
Digital Object Identifier: doi:10.1016/0047-259X(90)90059-Q
Zentralblatt MATH: 0709.62085
Tran, L. T. and Yakowitz, S. (1993). Nearest neighbor estimators for random fields. J. Multivariate Anal. 44 23--46.
Mathematical Reviews (MathSciNet): MR1208468
Digital Object Identifier: doi:10.1006/jmva.1993.1002
Zentralblatt MATH: 0764.62076
Whittle, P. (1954). On stationary processes in the plane. Biometrika 41 434--449.
Mathematical Reviews (MathSciNet): MR67450
Zentralblatt MATH: 0058.35601
Whittle, P. (1963). Stochastic process in several dimensions. Bull. Inst. Internat. Statist. 40 974--985.
Mathematical Reviews (MathSciNet): MR173287
Withers, C. S. (1981). Conditions for linear processes to be strong mixing. Z. Wahrsch. Verw. Gebiete 57 477--480.
Mathematical Reviews (MathSciNet): MR631371
Wu, W. B. and Mielniczuk, J. (2002). Kernel density estimation for linear processes. Ann. Statist. 30 1441--1459.
Mathematical Reviews (MathSciNet): MR1936325
Digital Object Identifier: doi:10.1214/aos/1035844982
Project Euclid: euclid.aos/1035844982
Zentralblatt MATH: 1015.62034
Yakowitz, S. (1987). Nearest-neighbor methods for time series analysis. J. Time Ser. Anal. 8 235--247.
Mathematical Reviews (MathSciNet): MR886141

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics