Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Quality Indicators for Preference-based Evolutionary Multi-objective Optimization Using a Reference Point: A Review and Analysis (2301.12148v3)

Published 28 Jan 2023 in cs.NE

Abstract: Some quality indicators have been proposed for benchmarking preference-based evolutionary multi-objective optimization algorithms using a reference point. Although a systematic review and analysis of the quality indicators are helpful for both benchmarking and practical decision-making, neither has been conducted. In this context, first, this paper reviews existing regions of interest and quality indicators for preference-based evolutionary multi-objective optimization using the reference point. We point out that each quality indicator was designed for a different region of interest. Then, this paper investigates the properties of the quality indicators. We demonstrate that an achievement scalarizing function value is not always consistent with the distance from a solution to the reference point in the objective space. We observe that the regions of interest can be significantly different depending on the position of the reference point and the shape of the Pareto front. We identify undesirable properties of some quality indicators. We also show that the ranking of preference-based evolutionary multi-objective optimization algorithms depends on the choice of quality indicators.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. K. Deb, S. Agrawal, A. Pratap, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182–197, 2002.
  2. E. Zitzler and S. Künzli, “Indicator-based selection in multiobjective search,” in Parallel Problem Solving from Nature (PPSN), 2004, pp. 832–842.
  3. Q. Zhang and H. Li, “MOEA/D: A multiobjective evolutionary algorithm based on decomposition,” IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712–731, 2007.
  4. R. C. Purshouse, K. Deb, M. M. Mansor, S. Mostaghim, and R. Wang, “A review of hybrid evolutionary multiple criteria decision making methods,” in IEEE Congress on Evol. Comput. (CEC).   IEEE, 2014, pp. 1147–1154.
  5. C. A. C. Coello, “Handling preferences in evolutionary multiobjective optimization: a survey,” in IEEE Congress on Evol. Comput. (CEC), 2000, pp. 30–37.
  6. S. Bechikh, M. Kessentini, L. B. Said, and K. Ghédira, “Chapter four - preference incorporation in evolutionary multiobjective optimization: A survey of the state-of-the-art,” Adv. Comput., vol. 98, pp. 141–207, 2015.
  7. A. B. Ruiz, R. Saborido, and M. Luque, “A preference-based evolutionary algorithm for multiobjective optimization: the weighting achievement scalarizing function genetic algorithm,” J. Glob. Optim., vol. 62, no. 1, pp. 101–129, 2015.
  8. A. P. Wierzbicki, “The use of reference objectives in multiobjective optimization,” in Multiple Criteria Decision Making Theory and Application.   Springer, 1980, pp. 468–486.
  9. K. Li, M. Liao, K. Deb, G. Min, and X. Yao, “Does preference always help? A holistic study on preference-based evolutionary multiobjective optimization using reference points,” IEEE Trans. Evol. Comput., vol. 24, no. 6, pp. 1078–1096, 2020.
  10. B. Afsar, K. Miettinen, and F. Ruiz, “Assessing the performance of interactive multiobjective optimization methods: A survey,” ACM Comput. Surv., vol. 54, no. 4, pp. 85:1–85:27, 2021.
  11. K. Miettinen and M. M. Mäkelä, “On scalarizing functions in multiobjective optimization,” OR Spectr., vol. 24, no. 2, pp. 193–213, 2002.
  12. K. Deb, J. Sundar, U. Bhaskara, and S. Chaudhuri, “Reference Point Based Multi-Objective Optimization Using Evolutionary Algorithms,” Int. J. Comput. Intell., vol. 2, no. 3, pp. 273–286, 2006.
  13. L. Thiele, K. Miettinen, P. J. Korhonen, and J. M. Luque, “A preference-based evolutionary algorithm for multi-objective optimization,” Evol. Comput., vol. 17, no. 3, pp. 411–436, 2009.
  14. K. Li, R. Chen, G. Min, and X. Yao, “Integration of preferences in decomposition multiobjective optimization,” IEEE Trans. Cybern., vol. 48, no. 12, pp. 3359–3370, 2018.
  15. E. Zitzler, L. Thiele, M. Laumanns, C. M. Fonseca, and V. G. da Fonseca, “Performance assessment of multiobjective optimizers: an analysis and review,” IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 117–132, 2003.
  16. M. Li and X. Yao, “Quality evaluation of solution sets in multiobjective optimisation: A survey,” ACM Comput. Surv., vol. 52, no. 2, pp. 26:1–26:38, 2019.
  17. J. G. Falcón-Cardona and C. A. C. Coello, “Indicator-based multi-objective evolutionary algorithms: A comprehensive survey,” ACM Comput. Surv., vol. 53, no. 2, pp. 29:1–29:35, 2021.
  18. E. Zitzler and L. Thiele, “Multiobjective optimization using evolutionary algorithms - A comparative case study,” in Parallel Problem Solving from Nature (PPSN).   Springer, 1998, pp. 292–304.
  19. C. A. C. Coello and M. R. Sierra, “A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm,” in Mexican International Conference on Artif. Intell. (MICAI), 2004, pp. 688–697.
  20. U. K. Wickramasinghe, R. Carrese, and X. Li, “Designing airfoils using a reference point based evolutionary many-objective particle swarm optimization algorithm,” in IEEE Congress on Evol. Comput. (CEC).   IEEE, 2010, pp. 1–8.
  21. J. Molina, L. V. Santana-Quintero, A. G. Hernández-Díaz, C. A. C. Coello, and R. Caballero, “g-dominance: Reference point based dominance for multiobjective metaheuristics,” Eur. J. Oper. Res., vol. 197, no. 2, pp. 685–692, 2009.
  22. L. B. Said, S. Bechikh, and K. Ghédira, “The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making,” IEEE Trans. Evol. Comput., vol. 14, no. 5, pp. 801–818, 2010.
  23. A. Mohammadi, M. N. Omidvar, and X. Li, “Reference point based multi-objective optimization through decomposition,” in IEEE Congress on Evol. Comput. (CEC).   IEEE, 2012, pp. 1–8.
  24. K. Li, K. Deb, and X. Yao, “R-metric: Evaluating the performance of preference-based evolutionary multiobjective optimization using reference points,” IEEE Trans. Evol. Comput., vol. 22, no. 6, pp. 821–835, 2018.
  25. A. Mohammadi, M. N. Omidvar, and X. Li, “A new performance metric for user-preference based multi-objective evolutionary algorithms,” in IEEE Congress on Evol. Comput. (CEC).   IEEE, 2013, pp. 2825–2832.
  26. Z. Hou, S. Yang, J. Zou, J. Zheng, G. Yu, and G. Ruan, “A performance indicator for reference-point-based multiobjective evolutionary optimization,” in IEEE Int. Symp. Comput. Intell. (SSCI), 2018, pp. 1571–1578.
  27. S. Bandaru and H. Smedberg, “A parameterless performance metric for reference-point based multi-objective evolutionary algorithms,” in Genetic and Evol. Comput. Conf. (GECCO), 2019, pp. 499–506.
  28. R. Tanabe and H. Ishibuchi, “An analysis of quality indicators using approximated optimal distributions in a 3-d objective space,” IEEE Trans. Evol. Comput., vol. 24, no. 5, pp. 853–867, 2020.
  29. G. Yu, J. Zheng, and X. Li, “An improved performance metric for multiobjective evolutionary algorithms with user preferences,” in IEEE Congress on Evol. Comput. (CEC), 2015, pp. 908–915.
  30. A. Mohammadi, M. N. Omidvar, X. Li, and K. Deb, “Integrating user preferences and decomposition methods for many-objective optimization,” in IEEE Congress on Evol. Comput. (CEC), 2014, pp. 421–428.
  31. L. He, H. Ishibuchi, A. Trivedi, H. Wang, Y. Nan, and D. Srinivasan, “A survey of normalization methods in multiobjective evolutionary algorithms,” IEEE Trans. Evol. Comput., vol. 25, no. 6, pp. 1028–1048, 2021.
  32. J. Knowles, L. Thiele, and E. Zitzler, “A tutorial on the performance assessment of stochastic multiobjective optimizers,” ETH Zurich, Tech. Rep. TIK-214, 2006.
  33. J. G. Falcón-Cardona, M. T. M. Emmerich, and C. A. C. Coello, “On the Construction of Pareto-Compliant Combined Indicators,” Evol. Comput., vol. 30, no. 3, pp. 381–408, 2022.
  34. K. Deb and A. Kumar, “Light beam search based multi-objective optimization using evolutionary algorithms,” in Proceedings of the IEEE Congress on Evol. Comput., CEC 2007, 25-28 September 2007, Singapore.   IEEE, 2007, pp. 2125–2132.
  35. X. Zhu, Z. Gao, Y. Du, S. Cheng, and F. Xu, “A decomposition-based multi-objective optimization approach considering multiple preferences with robust performance,” Appl. Soft Comput., vol. 73, pp. 263–282, 2018.
  36. W. Luo, L. Shi, X. Lin, and C. A. C. Coello, “The g^^𝑔\hat{g}over^ start_ARG italic_g end_ARG-dominance relation for preference-based evolutionary multi-objective optimization,” in IEEE Congress on Evol. Comput. (CEC), 2019, pp. 2418–2425.
  37. E. Filatovas, O. Kurasova, J. L. Redondo, and J. Fernández, “A reference point-based evolutionary algorithm for approximating regions of interest in multiobjective problems,” TOP, vol. 28, pp. 402–423, 2020.
  38. R. Tang, K. Li, W. Ding, Y. Wang, H. Zhou, and G. Fu, “Reference Point Based Multi-Objective Optimization of Reservoir Operation- a Comparison of Three Algorithms,” Water Resour. Manag., vol. 34, pp. 1005–1020, 2020.
  39. E. Filatovas, A. Lancinskas, O. Kurasova, and J. Zilinskas, “A preference-based multi-objective evolutionary algorithm R-NSGA-II with stochastic local search,” Central Eur. J. Oper. Res., vol. 25, no. 4, pp. 859–878, 2017.
  40. L. Nguyen, H. N. Xuan, and L. T. Bui, “Performance measurement for interactive multi-objective evolutionary algorithms,” in IEEE Conference on Knowledge and Systems Engineering, (KSE), 2015, pp. 302–305.
  41. F. Siegmund, A. H. C. Ng, and K. Deb, “Hybrid Dynamic Resampling for Guided Evolutionary Multi-Objective Optimization,” in Evolutionary Multi-Criterion Optimization (EMO), 2015, pp. 366–380.
  42. D. Cinalli, L. Martí, N. S. Pi, and A. C. B. Garcia, “Bio-inspired algorithms and preferences for multi-objective problems,” in Hybrid Artificial Intelligent Systems (HAIS), 2016, pp. 238–249.
  43. E. Filatovas, O. Kurasova, and K. Sindhya, “Synchronous R-NSGA-II: an extended preference-based evolutionary algorithm for multi-objective optimization,” Informatica, vol. 26, no. 1, pp. 33–50, 2015.
  44. L. Li, Y. Wang, H. Trautmann, N. Jing, and M. Emmerich, “Multiobjective evolutionary algorithms based on target region preferences,” Swarm Evol. Comput., vol. 40, pp. 196–215, 2018.
  45. P. A. Pour, S. Bandaru, B. Afsar, and K. Miettinen, “Desirable properties of performance indicators for assessing interactive evolutionary multiobjective optimization methods,” in Genetic and Evol. Comput. Conf. (GECCO, Companion), 2022, pp. 1803–1811.
  46. P. A. Pour, S. Bandaru, B. Afsar, M. Emmerich, and K. Miettinen, “A Performance Indicator for Interactive Evolutionary Multiobjective Optimization Methods,” IEEE Trans. Evol. Comput., 2023 (in press).
  47. D. Brockhoff, Y. Hamadi, and S. Kaci, “Using comparative preference statements in hypervolume-based interactive multiobjective optimization,” in Learn. and Intell. Opt. (LION), 2014, pp. 121–136.
  48. H. Zhu, Z. He, and Y. Jia, “An improved reference point based multi-objective optimization by decomposition,” Int. J. Mach. Learn. Cybern., vol. 7, no. 4, pp. 581–595, 2016.
  49. A. Jaszkiewicz and R. Slowinski, “The ’light beam search’ approach - an overview of methodology and applications,” Eur. J. Oper. Res., vol. 113, no. 2, pp. 300–314, 1999.
  50. X. Ma, F. Liu, Y. Qi, L. Li, L. Jiao, X. Deng, X. Wang, B. Dong, Z. Hou, Y. Zhang, and J. Wu, “MOEA/D with biased weight adjustment inspired by user preference and its application on multi-objective reservoir flood control problem,” Soft Comput., vol. 20, no. 12, pp. 4999–5023, 2016.
  51. F. Biscani and D. Izzo, “A parallel global multiobjective framework for optimization: pagmo,” J. Open Source Softw., vol. 5, no. 53, p. 2338, 2020.
  52. J. Blank and K. Deb, “Pymoo: Multi-objective optimization in python,” IEEE Access, vol. 8, pp. 89 497–89 509, 2020.
  53. K. Deb, L. Thiele, M. Laumanns, and E. Zitzler, “Scalable Test Problems for Evolutionary Multi-Objective Optimization,” in Evolutionary Multiobjective Optimization. Theoretical Advances and Applications.   Springer, 2005, pp. 105–145.
  54. K. Deb and H. Jain, “An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints,” IEEE Trans. Evol. Comput., vol. 18, no. 4, pp. 577–601, 2014.
  55. M. Li, L. Zhen, and X. Yao, “How to read many-objective solution sets in parallel coordinates [educational forum],” IEEE Comput. Intell. Mag., vol. 12, no. 4, pp. 88–100, 2017.
  56. M. G. Kendall, “A new measure of rank correlation,” Biometrika, vol. 30, pp. 81–93, 1938.
  57. E. Zitzler, K. Deb, and L. Thiele, “Comparison of multiobjective evolutionary algorithms: Empirical results,” Evol. Comput., vol. 8, no. 2, pp. 173–195, 2000.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Ryoji Tanabe (23 papers)
  2. Ke Li (723 papers)
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now