The Annals of Mathematical Statistics
- Ann. Math. Statist.
- Volume 43, Number 2 (1972), 636-644.
Discrete Dynamic Programming with Unbounded Rewards
Countable state and action Markov decision processes are investigated, the objective being to maximize expected discounted reward. Well-known results of Maitra and Blackwell are generalized, their assumption of bounded rewards being replaced by weaker conditions, the most important of which is as follows. The expected reward to be received at time $n + 1$ minus the actual reward received at time $n$, viewed as a function of the state at time $n$, the action at time $n$ and the decision rule to be followed at time $n + 1$, can be bounded. It is shown that there exists an $\varepsilon$-optimal stationary policy for every $\varepsilon > 0$ and that there exists an optimal stationary policy in the finite action case.
Ann. Math. Statist., Volume 43, Number 2 (1972), 636-644.
First available in Project Euclid: 27 April 2007
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Harrison, J. Michael. Discrete Dynamic Programming with Unbounded Rewards. Ann. Math. Statist. 43 (1972), no. 2, 636--644. doi:10.1214/aoms/1177692643. https://projecteuclid.org/euclid.aoms/1177692643