Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 12, Number 2 (2018), 2217-2237.
Prediction of dynamical time series using kernel based regression and smooth splines
Prediction of dynamical time series with additive noise using support vector machines or kernel based regression is consistent for certain classes of discrete dynamical systems. Consistency implies that these methods are effective at computing the expected value of a point at a future time given the present coordinates. However, the present coordinates themselves are noisy, and therefore, these methods are not necessarily effective at removing noise. In this article, we consider denoising and prediction as separate problems for flows, as opposed to discrete time dynamical systems, and show that the use of smooth splines is more effective at removing noise. Combination of smooth splines and kernel based regression yields predictors that are more accurate on benchmarks typically by a factor of 2 or more. We prove that kernel based regression in combination with smooth splines converges to the exact predictor for time series extracted from any compact invariant set of any sufficiently smooth flow. As a consequence of convergence, one can find examples where the combination of kernel based regression with smooth splines is superior by even a factor of $100$. The predictors that we analyze and compute operate on delay coordinate data and not the full state vector, which is typically not observable.
Electron. J. Statist., Volume 12, Number 2 (2018), 2217-2237.
Received: December 2017
First available in Project Euclid: 23 July 2018
Permanent link to this document
Digital Object Identifier
Navarrete, Raymundo; Viswanath, Divakar. Prediction of dynamical time series using kernel based regression and smooth splines. Electron. J. Statist. 12 (2018), no. 2, 2217--2237. doi:10.1214/18-EJS1429. https://projecteuclid.org/euclid.ejs/1532333003