February, 1966 A Statistical Basis for Approximation and Optimization
R. N. Rich
Ann. Math. Statist. 37(1): 59-65 (February, 1966). DOI: 10.1214/aoms/1177699598

## Abstract

Let $T$ be a compact metric space and let $D = \{t_1, t_2, \cdots\}$ be a countable dense subset. We propose to show that if for $x \varepsilon C(T)$ we define $x_n(t) = E(x(t) \mid x(t_1), \cdots, x(t_n))$ (conditional expectation) then $E\|x_n - x\|^p \rightarrow 0$ where $\|\cdot\|$ denotes the $\sup$ norm and $p \geqq 1$ is such that $E\|x\|^p < \infty$. Furthermore, if we measure the distance between $x_n$ and $x$ by $\int |x_n(t) - x(t)\|^2 d\mu(t)$ for some finite measure $\mu$ on $T$, then $x_n$ is (in a least square sense) the optimal prediction for $x$ given $x(t_1), \cdots, x(t_n)$. We also consider an optimization problem in this same probabilistic setting. Roughly stated, we consider how, given $x(t_1), \cdots, x(t_n)$, one should choose $t \varepsilon T$ so as to maximize $E(x(t))$. The existence of an optimal policy is proved. If we let $S(x)$ denote the supremum of $x$ over $T$ and let $v_n(x)$ denote $x(t)$ where $t$ is the point chosen in accordance with the optimal policy then it is shown that $E\|S(x) - v_n(x)\| \rightarrow 0$ as $n \rightarrow \infty$. This last result is obtained under the assumption that $E\|x\| < \infty$.

## Citation

R. N. Rich. "A Statistical Basis for Approximation and Optimization." Ann. Math. Statist. 37 (1) 59 - 65, February, 1966. https://doi.org/10.1214/aoms/1177699598

## Information

Published: February, 1966
First available in Project Euclid: 27 April 2007

zbMATH: 0158.17502
MathSciNet: MR187325
Digital Object Identifier: 10.1214/aoms/1177699598