A local linear kernel estimator of the regression function x↦g(x):=E[Yi|Xi=x], x∈ℝd, of a stationary (d+1)-dimensional spatial process {(Y i,Xi),i∈ℤN} observed over a rectangular domain of the form ℐn:={i=(i1,…,iN)∈ℤN|1≤ik≤nk,k=1,…,N}, n=(n1,…,nN)∈ℤN, is proposed and investigated. Under mild regularity assumptions, asymptotic normality of the estimators of g(x) and its derivatives is established. Appropriate choices of the bandwidths are proposed. The spatial process is assumed to satisfy some very general mixing conditions, generalizing classical time-series strong mixing concepts. The size of the rectangular domain ℐn is allowed to tend to infinity at different rates depending on the direction in ℤN.
References
Anselin, L. and Florax, R. J. G. M. (1995). New Directions in Spatial Econometrics. Springer, Berlin.
Besag, J. E. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Roy. Statist. Soc. Ser. B 36 192--236.
Mathematical Reviews (MathSciNet):
MR373208
Biau, G. (2003). Spatial kernel density estimation. Math. Methods Statist. 12 371--390.
Biau, G. and Cadre, B. (2004). Nonparametric spatial prediction. Stat. Inference Stoch. Process. 7 327--349.
Boente, G. and Fraiman, R. (1988). Consistency of a nonparametric estimate of a density function for dependent variables. J. Multivariate Anal. 25 90--99.
Mathematical Reviews (MathSciNet):
MR935296
Bolthausen, E. (1982). On the central limit theorem for stationary mixing random fields. Ann. Probab. 10 1047--1050.
Mathematical Reviews (MathSciNet):
MR672305
Bosq, D. (1989). Estimation et prévision nonparamétrique d'un processus stationnaire. C. R. Acad. Sci. Paris Sér. I Math. 308 453--456.
Mathematical Reviews (MathSciNet):
MR991881
Bradley, R. C. and Tran, L. T. (1999). Density estimation for nonisotropic random fields. J. Statist. Plann. Inference 81 51--70.
Carbon, M., Hallin, M. and Tran, L. T. (1996). Kernel density estimation for random fields: The $L_1$ theory. J. Nonparametr. Statist. 6 157--170.
Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots. J. Amer. Statist. Assoc. 74 829--836.
Mathematical Reviews (MathSciNet):
MR556476
Cleveland, W. S. and Loader, C. (1996). Smoothing by local regression: Principles and methods. In Statistical Theory and Computational Aspects of Smoothing (W. Härdle and M. G. Schimek, eds.) 10--49. Physica, Heidelberg.
Cressie, N. A. C. (1991). Statistics for Spatial Data. Wiley, New York.
Deo, C. M. (1973). A note on empirical processes of strong mixing sequences. Ann. Probab. 1 870--875.
Mathematical Reviews (MathSciNet):
MR356160
Devroye, L. and Györfi, L. (1985). Nonparametric Density Estimation: The $L_1$ View. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR780746
Fan, J. (1992). Design-adaptive nonparametric regression. \JASA 87 998--1004.
Fan, J. and Gijbels, I. (1992). Variable bandwidth and local linear regression smoothers. Ann. Statist. 20 2008--2036.
Fan, J. and Gijbels, I. (1995). Data-driven bandwidth selection in local polynomial fitting: Variable bandwidth and spatial adaptation. J. Roy. Statist. Soc. Ser. B 57 371--394.
Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
Fan, J. and Yao, Q. (2003). Nonlinear Time Series: Nonparametric and Parametric Methods. Springer, New York.
Guyon, X. (1987). Estimation d'un champ par pseudo-vraisemblance conditionnelle: Étude asymptotique et application au cas Markovien. In Spatial Processes and Spatial Time Series Analysis. Proc. 6th Franco--Belgian Meeting of Statisticians (J.-J. Droesbeke et al., eds.) 15--62. FUSL, Brussels.
Mathematical Reviews (MathSciNet):
MR947996
Guyon, X. (1995). Random Fields on a Network. Springer, New York.
Györfi, L., Härdle, W., Sarda, P. and Vieu, P. (1989). Nonparametric Curve Estimation From Time Series. Lecture Notes in Statist. 60. Springer, New York.
Hallin, M., Lu, Z. and Tran, L. T. (2001). Density estimation for spatial linear processes. Bernoulli 7 657--668.
Hallin, M., Lu, Z. and Tran, L. T. (2004). Density estimation for spatial processes: The $L_1$ theory. J. Multivariate Anal. 88 61--75.
Hallin, M. and Tran, L. T. (1996). Kernel density estimation for linear processes: Asymptotic normality and optimal bandwidth derivation. \AISM 48 429--449.
Hastie, T. and Loader, C. (1993). Local regression: Automatic kernel carpentry (with discussion). Statist. Sci. 8 120--143.
Ibragimov, I. A. and Linnik, Yu. V. (1971). Independent and Stationary Sequences of Random Variables. Wolters-Noordhoff, Groningen.
Mathematical Reviews (MathSciNet):
MR322926
Ioannides, D. A. and Roussas, G. G. (1987). Note on the uniform convergence of density estimates for mixing random variables. Statist. Probab. Lett. 5 279--285.
Mathematical Reviews (MathSciNet):
MR896459
Lu, Z. (1998). On geometric ergodicity of a non-linear autoregressive model with an autoregressive conditional heteroscedastic term. Statist. Sinica 8 1205--1217.
Lu, Z. (2001). Asymptotic normality of kernel density estimators under dependence. \AISM 53 447--468.
Lu, Z. and Chen, X. (2002). Spatial nonparametric regression estimation: Nonisotropic case. Acta Math. Appl. Sinica (English Ser.) 18 641--656.
Lu, Z. and Chen, X. (2004). Spatial kernel regression estimation: Weak consistency. Statist. Probab. Lett. 68 125--136.
Lu, Z. and Cheng, P. (1997). Distribution-free strong consistency for nonparametric kernel regression involving nonlinear time series. \JSPI 65 67--86.
Masry, E. (1983). Probability density estimation from sampled data. IEEE Trans. Inform. Theory 29 696--709.
Mathematical Reviews (MathSciNet):
MR730907
Masry, E. (1986). Recursive probability density estimation for weakly dependent processes. IEEE Trans. Inform. Theory 32 254--267.
Mathematical Reviews (MathSciNet):
MR838413
Masry, E. and Fan, J. (1997). Local polynomial estimation of regression functions for mixing processes. Scand. J. Statist. 24 165--179.
Masry, E. and Györfi, L. (1987). Strong consistency and rates for recursive density estimators for stationary mixing processes. J. Multivariate Anal. 22 79--93.
Mathematical Reviews (MathSciNet):
MR890884
Masry, E. and Tjøstheim, D. (1995). Nonparametric estimation and identification of nonlinear ARCH time series: Strong consistency and asymptotic normality. Econometric Theory 11 258--289.
Nakhapetyan, B. S. (1980). The central limit theorem for random fields with mixing conditions. In Multicomponent Random Systems (R. L. Dobrushin and Ya. G. Sinai, eds.) 531--548. Dekker, New York.
Mathematical Reviews (MathSciNet):
MR599547
Nakhapetyan, B. S. (1987). An approach to proving limit theorems for dependent random variables. Theory Probab. Appl. 32 535--539.
Mathematical Reviews (MathSciNet):
MR914955
Neaderhouser, C. C. (1980). Convergence of blocks spins defined by a random field. J. Statist. Phys. 22 673--684.
Mathematical Reviews (MathSciNet):
MR579097
Pham, T. D. (1986). The mixing properties of bilinear and generalized random coefficient autoregressive models. Stochastic Process. Appl. 23 291--300.
Mathematical Reviews (MathSciNet):
MR876051
Pham, D. T. and Tran, L. T. (1985). Some mixing properties of time series models. Stochastic Process. Appl. 19 297--303.
Mathematical Reviews (MathSciNet):
MR787587
Possolo, A. (1991). Spatial Statistics and Imaging. IMS, Hayward, CA.
Ripley, B. (1981). Spatial Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR624436
Robinson, P. M. (1983). Nonparametric estimators for time series. J. Time Ser. Anal. 4 185--207.
Mathematical Reviews (MathSciNet):
MR732897
Robinson, P. M. (1987). Time series residuals with application to probability density estimation. J. Time Ser. Anal. 8 329--344.
Mathematical Reviews (MathSciNet):
MR903762
Rosenblatt, M. (1985). Stationary Sequences and Random Fields. Birkhäuser, Boston.
Mathematical Reviews (MathSciNet):
MR885090
Roussas, G. G. (1969). Nonparametric estimation of the transition distribution function of a Markov process. Ann. Math. Statist. 40 1386--1400.
Mathematical Reviews (MathSciNet):
MR246471
Roussas, G. G. (1988). Nonparametric estimation in mixing sequences of random variables. \JSPI 18 135--149.
Mathematical Reviews (MathSciNet):
MR922204
Ruppert, D. and Wand, M. P. (1994). Multivariate locally weighted least squares regression. \ANNALS 22 1346--1370.
Stone, C. J. (1977). Consistent nonparametric regression (with discussion). \ANNALS 5 595--645.
Mathematical Reviews (MathSciNet):
MR443204
Takahata, H. (1983). On the rates in the central limit theorem for weakly dependent random fields. Z. Wahrsch. Verw. Gebiete 64 445--456.
Mathematical Reviews (MathSciNet):
MR717753
Tjøstheim, D. (1990). Nonlinear time series and Markov chains. Adv. in Appl. Probab. 22 587--611.
Tran, L. T. (1989). The $L_1$ convergence of kernel density estimates under dependence. Canad. J. Statist. 17 197--208.
Tran, L. T. (1990). Kernel density estimation on random fields. J. Multivariate Anal. 34 37--53.
Tran, L. T. and Yakowitz, S. (1993). Nearest neighbor estimators for random fields. J. Multivariate Anal. 44 23--46.
Whittle, P. (1954). On stationary processes in the plane. Biometrika 41 434--449.
Mathematical Reviews (MathSciNet):
MR67450
Whittle, P. (1963). Stochastic process in several dimensions. Bull. Inst. Internat. Statist. 40 974--985.
Mathematical Reviews (MathSciNet):
MR173287
Withers, C. S. (1981). Conditions for linear processes to be strong mixing. Z. Wahrsch. Verw. Gebiete 57 477--480.
Mathematical Reviews (MathSciNet):
MR631371
Wu, W. B. and Mielniczuk, J. (2002). Kernel density estimation for linear processes. Ann. Statist. 30 1441--1459.
Yakowitz, S. (1987). Nearest-neighbor methods for time series analysis. J. Time Ser. Anal. 8 235--247.
Mathematical Reviews (MathSciNet):
MR886141