Bayes Solution of Sequential Decision Problem for Markov Dependent Observations

Abstract

After discussing the sequential decision problem in the general case and its Bayes solution as given by Wald [11], LeCam [8] and others, in Section 2, we give the integral equation satisfied by the Bayes risk. In Section 3 we specialise to Markov dependent observations and in the last section we give an illustrative example.