Advances in Applied Probability

Markov decision process algorithms for wealth allocation problems with defaultable bonds

Iker Perez, David Hodge, and Huiling Le

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text


In this paper we are concerned with analysing optimal wealth allocation techniques within a defaultable financial market similar to Bielecki and Jang (2007). We study a portfolio optimization problem combining a continuous-time jump market and a defaultable security; and present numerical solutions through the conversion into a Markov decision process and characterization of its value function as a unique fixed point to a contracting operator. In this paper we analyse allocation strategies under several families of utility functions, and highlight significant portfolio selection differences with previously reported results.

Article information

Adv. in Appl. Probab., Volume 48, Number 2 (2016), 392-405.

First available in Project Euclid: 9 June 2016

Permanent link to this document

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 91G10: Portfolio theory
Secondary: 90C40: Markov and semi-Markov decision processes

Portfolio optimization defaultable bond Markov decision process


Perez, Iker; Hodge, David; Le, Huiling. Markov decision process algorithms for wealth allocation problems with defaultable bonds. Adv. in Appl. Probab. 48 (2016), no. 2, 392--405.

Export citation


  • Almudevar, A. (2001). A dynamic programming algorithm for the optimal control of piecewise deterministic Markov processes. SIAM J. Control Optimization. 40, 525–539.
  • Bäuerle, N. and Rieder, U. (2009). MDP algorithms for portfolio optimization problems in pure jump markets. Finance Stoch. 13, 591–611.
  • Bäuerle, N. and Rieder, U. (2010). Optimal control of piecewise deterministic Markov processes with finite time horizon. In Modern Trends in Controlled Stochastic Processes: Theory and Applications, Luniver, Frome, pp. 123–143.
  • Bäuerle, N. and Rieder, U. (2011). Markov Decision Processes with Applications to Finance. Springer, Heidelberg.
  • Bertsekas, D. P. and Shreve, S. E. (1978). Stochastic Optimal Control. Academic Press, New York.
  • Bielecki, T. R. and Jang, I. (2006). Portfolio optimization with a defaultable security. Asia–Pacific Financial Markets 13, 113–127.
  • Bielecki, T. R. and Rutkowski, M. (2002). Credit Risk: Modelling, Valuation and Hedging. Springer, Berlin.
  • Bo, L., Wang, Y. and Yang, X. (2010). An optimal portfolio problem in a defaultable market. Adv. Appl. Prob. 42, 689–705.
  • Capponi, A. and Figueroa-López, J. E. (2014). Dynamic portfolio optimization with a defaultable security and regime-switching. Math. Finance 24, 207–249.
  • Duffie, D. and Singleton, K. J. (1999). Modelling term structures of defaultable bonds. Rev. Financial Studies 12, 687–720.
  • Fleming, W. H. and Pang, T. (2004). An application of stochastic control theory to financial economics. SIAM J. Control Optimization 43, 502–531.
  • Jeanblanc, M., Yor, M. and Chesney, M. (2009). Mathematical Methods for Financial Markets. Springer, London.
  • Karatzas, I. and Shreve, S. E. (1998). Methods of Mathematical Finance. Springer, New York.
  • Kirch, M. and Runggaldier, W. J. (2004). Efficient hedging when asset prices follow a geometric Poisson process with unknown intensities. SIAM J. Control Optimization 43, 1174–1195.
  • Lakner, P. and Liang, W. (2007). Optimal investment in a defaultable bond. Math. Financial Econom. 1, 283–310.
  • Merton, R. C. (1969). Lifetime portfolio selection under uncertainty: the continuous-time case. Rev. Econom. Statist. 51, 247–257.
  • Pham, H. (2002). Smooth solutions to optimal investment models with stochastic volatilities and portfolio constraints. Appl. Math. Optimization 46, 55–78.
  • Puterman, M. L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley, New York.