We consider a dynamic control problem associated with a generalized Brownian network, the objective being to minimize expected discounted cost over an infinite planning horizon. In this Brownian control problem (BCP), both the system manager’s control and the associated cumulative cost process may be locally of unbounded variation. Due to this aspect of the cost process, both the precise statement of the problem and its analysis involve delicate technical issues. We show that the BCP is equivalent, in a certain sense, to a reduced Brownian control problem (RBCP) of lower dimension. The RBCP is a singular stochastic control problem, in which both the controls and the cumulative cost process are locally of bounded variation.
References
Avriel, M., Diewert, W. E., Schaible, S. and Zang, I. (1988). Generalized Concavity. Plenum, New York. MR927084 0679.90029 Avriel, M., Diewert, W. E., Schaible, S. and Zang, I. (1988). Generalized Concavity. Plenum, New York. MR927084 0679.90029
Bohm, V. (1975). On the continuity of the optimal policy set for linear programs. SIAM J. Appl. Math. 28 303–306. MR371390 0294.90047 10.1137/0128026 Bohm, V. (1975). On the continuity of the optimal policy set for linear programs. SIAM J. Appl. Math. 28 303–306. MR371390 0294.90047 10.1137/0128026
Bramson, M. and Williams, R. J. (2003). Two workload properties for Brownian networks. Queueing Systems Theory Appl. 45 191–221. 1131.60305 10.1023/A:1027372517452 Bramson, M. and Williams, R. J. (2003). Two workload properties for Brownian networks. Queueing Systems Theory Appl. 45 191–221. 1131.60305 10.1023/A:1027372517452
Dantzig, G. B., Folkman, J. and Shapiro, N. (1967). On the continuity of the minimum set of a continuous function. J. Math. Anal. Appl. 17 519–548. 0153.49201 10.1016/0022-247X(67)90139-4 Dantzig, G. B., Folkman, J. and Shapiro, N. (1967). On the continuity of the minimum set of a continuous function. J. Math. Anal. Appl. 17 519–548. 0153.49201 10.1016/0022-247X(67)90139-4
Harrison, J. M. (1988). Brownian models of queueing networks with heterogeneous customer populations. In Stochastic Differential Systems, Stochastic Control Theory and Their Applications (W. Fleming and P. L. Lions, eds.) 147–186. Springer, New York. 0658.60123 Harrison, J. M. (1988). Brownian models of queueing networks with heterogeneous customer populations. In Stochastic Differential Systems, Stochastic Control Theory and Their Applications (W. Fleming and P. L. Lions, eds.) 147–186. Springer, New York. 0658.60123
Harrison, J. M. (2000). Brownian models of open processing networks: Canonical representation of workload. Ann. Appl. Probab. 10 75–103. [Correction Ann. Appl. Probab. 13 (2003) 390–393.] 1131.60306 10.1214/aoap/1019737665 euclid.aoap/1019737665 Harrison, J. M. (2000). Brownian models of open processing networks: Canonical representation of workload. Ann. Appl. Probab. 10 75–103. [Correction Ann. Appl. Probab. 13 (2003) 390–393.] 1131.60306 10.1214/aoap/1019737665 euclid.aoap/1019737665
Harrison, J. M. (2002). Stochastic networks and activity analysis. In Analytic Methods in Applied Probability (Yu. Suhov, ed.) 53–76. Amer. Math. Soc., Providence, RI. 1066.90012 Harrison, J. M. (2002). Stochastic networks and activity analysis. In Analytic Methods in Applied Probability (Yu. Suhov, ed.) 53–76. Amer. Math. Soc., Providence, RI. 1066.90012
Harrison, J. M. (2003). A broader view of Brownian networks. Ann. Appl. Probab. 13 1119–1150. 1060.90020 10.1214/aoap/1060202837 euclid.aoap/1060202837 Harrison, J. M. (2003). A broader view of Brownian networks. Ann. Appl. Probab. 13 1119–1150. 1060.90020 10.1214/aoap/1060202837 euclid.aoap/1060202837
Harrison, J. M. and Taksar, M. I. (1982). Instantaneous control of Brownian motion. Math. Oper. Res. 8 439–453. 0523.93068 10.1287/moor.8.3.439 Harrison, J. M. and Taksar, M. I. (1982). Instantaneous control of Brownian motion. Math. Oper. Res. 8 439–453. 0523.93068 10.1287/moor.8.3.439
Harrison, J. M. and Van Mieghem, J. A. (1997). Dynamic control of Brownian networks: State space collapse and equivalent workload formulations. Ann. Appl. Probab. 7 747–771. 0885.60080 10.1214/aoap/1034801252 euclid.aoap/1034801252 Harrison, J. M. and Van Mieghem, J. A. (1997). Dynamic control of Brownian networks: State space collapse and equivalent workload formulations. Ann. Appl. Probab. 7 747–771. 0885.60080 10.1214/aoap/1034801252 euclid.aoap/1034801252
Kushner, H. J. and Dupuis, P. G. (2001). Numerical Methods for Stochastic Control Problems in Continuous Time. Springer, New York. 0968.93005 Kushner, H. J. and Dupuis, P. G. (2001). Numerical Methods for Stochastic Control Problems in Continuous Time. Springer, New York. 0968.93005
Rockafellar, R. T. and Wets, R. J.-B. (1998). Variational Analysis. Springer, New York. 0888.49001 Rockafellar, R. T. and Wets, R. J.-B. (1998). Variational Analysis. Springer, New York. 0888.49001
Taylor, L. M. and Williams, R. J. (1993). Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant. Probab. Theory Related Fields 96 283–317. Taylor, L. M. and Williams, R. J. (1993). Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant. Probab. Theory Related Fields 96 283–317.
