Journal of Applied Mathematics

  • J. Appl. Math.
  • Volume 2013, Special Issue (2013), Article ID 750819, 12 pages.

Harmony Search Based Parameter Ensemble Adaptation for Differential Evolution

Rammohan Mallipeddi

Full-text: Open access

Abstract

In differential evolution (DE) algorithm, depending on the characteristics of the problem at hand and the available computational resources, different strategies combined with a different set of parameters may be effective. In addition, a single, well-tuned combination of strategies and parameters may not guarantee optimal performance because different strategies combined with different parameter settings can be appropriate during different stages of the evolution. Therefore, various adaptive/self-adaptive techniques have been proposed to adapt the DE strategies and parameters during the course of evolution. In this paper, we propose a new parameter adaptation technique for DE based on ensemble approach and harmony search algorithm (HS). In the proposed method, an ensemble of parameters is randomly sampled which form the initial harmony memory. The parameter ensemble evolves during the course of the optimization process by HS algorithm. Each parameter combination in the harmony memory is evaluated by testing them on the DE population. The performance of the proposed adaptation method is evaluated using two recently proposed strategies (DE/current-to-pbest/bin and DE/current-to-gr_best/bin) as basic DE frameworks. Numerical results demonstrate the effectiveness of the proposed adaptation technique compared to the state-of-the-art DE based algorithms on a set of challenging test problems (CEC 2005).

Article information

Source
J. Appl. Math., Volume 2013, Special Issue (2013), Article ID 750819, 12 pages.

Dates
First available in Project Euclid: 14 March 2014

Permanent link to this document
https://projecteuclid.org/euclid.jam/1394807373

Digital Object Identifier
doi:10.1155/2013/750819

Zentralblatt MATH identifier
1312.68174

Citation

Mallipeddi, Rammohan. Harmony Search Based Parameter Ensemble Adaptation for Differential Evolution. J. Appl. Math. 2013, Special Issue (2013), Article ID 750819, 12 pages. doi:10.1155/2013/750819. https://projecteuclid.org/euclid.jam/1394807373


Export citation

References

  • P. J. Angeline, M. Palaniswami, Y. Attikiouzel, R. J. Marks, D. Fogel, and T. Fukuda, “Adaptive and self-adaptive evolutionary computation,” Computational Intelligence, pp. 152–161, 1995.
  • Á. E. Eiben, R. Hinterding, and Z. Michalewicz, “Parameter control in evolutionary algorithms,” IEEE Transactions on Evolutionary Computation, vol. 3, no. 2, pp. 124–141, 1999.
  • J. Gomez, D. Dasgupta, and F. Gonazalez, “Using adaptive operators in genetic search,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'03), Chicago, Ill, USA, 2003.
  • B. R. Julstrom, “What have you done for me lately? Adapting operator probabilities in a steady-state genetic algorithm,” in Proceedings of the 6th International Conference on Genetic Algorithms, Pittsburgh, Pa, USA, 1995.
  • J. E. Smith and T. C. Fogarty, “Operator and parameter adaptation in genetic algorithms,” Soft Computing, vol. 1, pp. 81–87, 1997.
  • A. Tuson and P. Ross, “Adapting operator settings in genetic algorithms,” Evolutionary Computation, vol. 6, no. 2, pp. 161–184, 1998.
  • J. Brest, S. Greiner, B. Bošković, M. Mernik, and V. Zumer, “Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems,” IEEE Transactions on Evolutionary Computation, vol. 10, no. 6, pp. 646–657, 2006.
  • R. Storn and K. Price, “Differential evolution–-a simple and efficient adaptive scheme for global optimization over continuous spaces,” Tech. Rep. TR-95-012, ICSI, http://ftp.icsi.berkeley.edu/ftp/pub/techreports/1995/tr-95-012.pdf.
  • R. Joshi and A. C. Sanderson, “Minimal representation multisensor fusion using differential evolution,” IEEE Transactions on Systems, Man, and Cybernetics Part A, vol. 29, no. 1, pp. 63–76, 1999.
  • T. Rogalsky, R. W. Derksen, and S. Kocabiyik, “Differential evolution in aerodynamic optimization,” in Proceedings of 46th Annual Conference of Canadian Aeronautics and Space Institute, pp. 29–36, Montreal, Quebec, 1999.
  • M. K. Venu, R. Mallipeddi, and P. N. Suganthan, “Fiber Bragg grating sensor array interrogation using differential evolution,” Optoelectronics and Advanced Materials, Rapid Communications, vol. 2, no. 11, pp. 682–685, 2008.
  • S. Das, A. Abraham, U. K. Chakraborty, and A. Konar, “Differential evolution using a neighborhood-based mutation operator,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 3, pp. 526–553, 2009.
  • J. Liu and J. Lampinen, “On setting the control parameter of the differential evolution method,” in Proceedings of 8th International Conference on Soft Computing (MENDEL '02), pp. 11–18, 2002.
  • A. K. Qin, V. L. Huang, and P. N. Suganthan, “Differential evolution algorithm with strategy adaptation for global numerical optimization,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 2, pp. 398–417, 2009.
  • M. G. H. Omran, A. Salman, and A. P. Engelbrecht, “Self-adaptive differential evolution,” in Proceedings of the Computational Intelligence and Security (LNCS '05), pp. 192–199, 2005.
  • D. Zaharie, “Control of population diversity and adaptation in differential evolution algorithms,” in Proceedings of the 9th International Conference on Soft Computing, Brno, Czech Republic, 2003.
  • J. Tvrdík, “Adaptation in differential evolution: a numerical comparison,” Applied Soft Computing Journal, vol. 9, no. 3, pp. 1149–1155, 2009.
  • Z. Jingqiao and A. C. Sanderson, “JADE: adaptive differential evolution with optional external archive,” IEEE Transactions on Evolutionary Computation, vol. 13, pp. 945–958, 2009.
  • S. M. Islam, S. Das, S. Ghosh, S. Roy, and P. N. Suganthan, “An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 42, no. 2, pp. 482–500, 2012.
  • R. Mallipeddi, P. N. Suganthan, Q. K. Pan, and M. F. Tasgetiren, “Differential evolution algorithm with ensemble of parameters and mutation strategies,” Applied Soft Computing Journal, vol. 11, no. 2, pp. 1679–1696, 2011.
  • Z. W. Geem, J. H. Kim, and G. V. Loganathan, “A new heuristic optimization algorithm: harmony search,” Simulation, vol. 76, no. 2, pp. 60–68, 2001.
  • M. G. H. Omran and M. Mahdavi, “Global-best harmony search,” Applied Mathematics and Computation, vol. 198, no. 2, pp. 643–656, 2008.
  • L.-P. Li and L. Wang, “Hybrid algorithms based on harmony search and differential evolution for global optimization,” in Proceedings of the 1st ACM/SIGEVO Summit on Genetic and Evolutionary Computation, (GEC '09), pp. 271–278, Shanghai, China, June 2009.
  • R. Storn, “On the usage of differential evolution for function optimization,” in Proceedings of the Biennial Conference of the North American Fuzzy Information Processing Society (NAFIPS '96), Berkeley, Calif, USA, June 1996.
  • R. Storn and K. Price, “Differential evolution–-a simple and efficient heuristic for global optimization over continuous spaces,” Journal of Global Optimization, vol. 11, no. 4, pp. 341–359, 1997.
  • R. Gämperle, S. D. Müller, and P. Koumoutsakos, “A parameter study for differential evolution,” in Proceedings of the Advances in Intelligent Systems, Fuzzy Systems, Evolutionary Computation, Interlaken, Switzerland, 2002.
  • S. Das, A. Konar, and U. K. Chakraborty, “Two improved differential evolution schemes for faster global search,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 991–998, June 2005.
  • J. Lampinen and I. Zelinka, “On stagnation of the differential evolution algorithm,” in Proceedings of 6th International Mendel Conference on Soft Computing (MENDEL '00), pp. 76–83, 2000.
  • K. V. Price, R. M. Storn, and J. A. Lampinen, Differential Evolution : A Practical Approach to Global Optimization, Natural Computing Series, Springer, Berlin, Germany, 2005.
  • J. Rönkkönen, S. Kukkonen, and K. V. Price, “Real-parameter optimization with differential evolution,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC'05), pp. 506–513, Edinburgh, Scotland, September 2005.
  • K. V. Price, “An introduction to differential evolution,” in New Ideas in Optimization, D. Corne, M. Dorgio, and F. Glover, Eds., pp. 79–108, McGraw-Hill, London, UK, 1999.
  • A. Iorio and X. Li, “Solving rotated multi-objective optimization problems using differential evolution,” in Proceedings of the Australian Conference on Artificial Intelligence, Cairns, Australia, 2004.
  • D. Zaharie, “Critical values for the control parameters of differential evolution,” in Proceedings of 18th International Conference on Soft Computing (MENDEL '02), pp. 62–67, Brno, Czech Republic, 2002.
  • J. Rönkkönen and J. Lampinen, “On using normally distributed mutation step length for the differential evolution algorithm,” in Proceedings of 19th International MENDEL Confernce on Soft Computing (MENDEL '03), pp. 11–18, Brno, Czech Republic, 2003.
  • D. Zaharie, “Influence of crossover on the behavior of differential evolution algorithms,” Applied Soft Computing Journal, vol. 9, no. 3, pp. 1126–1138, 2009.
  • E. Mezura-Montes, J. Velázquez-Reyes, and C. A. Coello Coello, “Modified differential evolution for constrained optimization,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '06), pp. 25–32, July 2006.
  • H. A. Abbass, “The self-adaptive pareto differential evolution algorithm,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '02), vol. 1, pp. 831–836, 2002.
  • J. Liu and J. Lampinen, “A fuzzy adaptive differential evolution algorithm,” Soft Computing, vol. 9, no. 6, pp. 448–462, 2005.
  • D. Zaharie and D. Petcu, “Adaptive Pareto differential evolution and its parallelization,” in Proceedings of 5th International Conference on Parallel Processing and Applied Mathematics, pp. 261–268, Czestochowa, Poland, 2003.
  • S. Das and P. N. Suganthan, “Differential evolution: a survey of the state-of-the-art,” IEEE Transactions on Evolutionary Computation, vol. 15, no. 1, pp. 4–31, 2011.
  • X.-S. Yang, “Harmony search as a metaheuristic algorithm,” in Music-Inspired Harmony Search Algorithm, Z. Geem, Ed., vol. 191, pp. 1–14, Springer, Berlin, Germany, 2009.
  • O. M. Alia and R. Mandava, “The variants of the harmony search algorithm: an overview,” Artificial Intelligence Review, vol. 36, no. 1, pp. 49–68, 2011.
  • P. N. Suganthan, N. N. Hansen, J. J. Liang et al., Problem Definitions and Evaluation Criteria For the CEC, 2005 Special Session on Real-Parameter Optimization, Nanyang Technological University; Singapore and KanGAL; IIT, Kanpur, India, 2005.
  • S. García, D. Molina, M. Lozano, and F. Herrera, “A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization,” Journal of Heuristics, vol. 15, no. 6, pp. 617–644, 2009.