UMOEA/D: A Multiobjective Evolutionary Algorithm for Uniform Pareto Objectives based on Decomposition (2402.09486v1)
Abstract: Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences. Previous methods commonly utilize the set of Pareto objectives (particles on the PF) to represent the entire PF. However, the empirical distribution of the Pareto objectives on the PF is rarely studied, which implicitly impedes the generation of diverse and representative Pareto objectives in previous methods. To bridge the gap, we suggest in this paper constructing \emph{uniformly distributed} Pareto objectives on the PF, so as to alleviate the limited diversity found in previous MOO approaches. We are the first to formally define the concept of ``uniformity" for an MOO problem. We optimize the maximal minimal distances on the Pareto front using a neural network, resulting in both asymptotically and non-asymptotically uniform Pareto objectives. Our proposed method is validated through experiments on real-world and synthetic problems, which demonstrates the efficacy in generating high-quality uniform Pareto objectives and the encouraging performance exceeding existing state-of-the-art methods. The detailed model implementation and the code are scheduled to be open-sourced upon publication.
- A convergence theory for deep learning via over-parameterization. In International conference on machine learning, pp. 242–252. PMLR, 2019.
- Hypervolume-based multiobjective optimization: Theoretical foundations and practical implications. Theoretical Computer Science, 425:75–103, 2012.
- Complexity iteration analysis for strongly convex multi-objective optimization using a newton path-following procedure. Optimization Letters, 15:1215–1227, 2021.
- Multiobjective optimization of non-smooth pde-constrained problems. arXiv preprint arXiv:2308.01113, 2023.
- Sms-emoa: Multiobjective selection based on dominated hypervolume. European Journal of Operational Research, 181(3):1653–1669, 2007.
- pymoo: Multi-objective optimization in python. IEEE Access, 8:89497–89509, 2020.
- Generating well-spaced points on a unit simplex for evolutionary many-objective optimization. IEEE Transactions on Evolutionary Computation, 25(1):48–60, 2020.
- Generating well-spaced points on a unit simplex for evolutionary many-objective optimization. IEEE Transactions on Evolutionary Computation, 2020.
- Asymptotics of best-packing on rectifiable sets. Proceedings of the American Mathematical Society, 135(8):2369–2380, 2007.
- Discrete energy on rectifiable sets. Springer, 2019.
- Multi-objective optimization. Multi-objective Management in Freight Logistics: Increasing Capacity, Service Level, Sustainability, and Safety with Optimization Algorithms, pp. 21–51, 2020.
- Wasserstein upper bounds of the total variation for smooth densities. Statistics & Probability Letters, 163:108771, 2020.
- Multi-objective deep learning with adaptive reference vectors. Advances in Neural Information Processing Systems, 35:32723–32735, 2022.
- Normal-boundary intersection: A new method for generating the pareto surface in nonlinear multicriteria optimization problems. SIAM journal on optimization, 8(3):631–657, 1998.
- Moea/d with uniformly randomly adaptive weights. In Proceedings of the genetic and evolutionary computation conference, pp. 641–648, 2018.
- Self-adaptive genetic algorithms with simulated binary crossover. Evolutionary computation, 9(2):197–221, 2001.
- Analysing mutation schemes for real-parameter genetic algorithms. International Journal of Artificial Intelligence and Soft Computing, 4(1):1–28, 2014.
- Simulated binary crossover for continuous search space. Complex systems, 9(2):115–148, 1995.
- A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE transactions on evolutionary computation, 6(2):182–197, 2002a.
- Scalable multi-objective optimization test problems. In Proceedings of the 2002 Congress on Evolutionary Computation. CEC’02 (Cat. No. 02TH8600), volume 1, pp. 825–830. IEEE, 2002b.
- Multi-objective test problems, linkages, and evolutionary methodologies. In Proceedings of the 8th annual conference on Genetic and evolutionary computation, pp. 1141–1148, 2006.
- Generating uniformly distributed points on a unit simplex for evolutionary many-objective optimization. In Evolutionary Multi-Criterion Optimization: 10th International Conference, EMO 2019, East Lansing, MI, USA, March 10-13, 2019, Proceedings 10, pp. 179–190. Springer, 2019.
- Moea/d with a self-adaptive weight vector adjustment strategy based on chain segmentation. Information Sciences, 521:209–230, 2020.
- Durrett, R. Probability: theory and examples, volume 49. Cambridge university press, 2019.
- Ehrgott, M. Multicriteria optimization, volume 491. Springer Science & Business Media, 2005.
- Approximating complex pareto fronts with predefined normal-boundary intersection directions. IEEE Transactions on Evolutionary Computation, 24(5):809–823, 2019.
- Folland, G. B. Real analysis: modern techniques and their applications, volume 40. John Wiley & Sons, 1999.
- The hypervolume indicator: Problems and algorithms. arXiv preprint arXiv:2005.00515, 2020.
- A practical guide to multi-objective reinforcement learning and planning. Autonomous Agents and Multi-Agent Systems, 36(1):26, 2022.
- Hillermeier, C. Generalized homotopy approach to multiobjective optimization. Journal of Optimization Theory and Applications, 110(3):557–583, 2001.
- Revisiting scalarization in multi-task learning: A theoretical perspective. arXiv preprint arXiv:2308.13985, 2023.
- Two-type weight adjustments in moea/d for highly constrained many-objective optimization. Information Sciences, 578:592–614, 2021.
- An adaptive evolutionary multi-objective approach based on simulated annealing. Evolutionary computation, 19(4):561–595, 2011.
- An evolutionary many-objective optimization algorithm based on dominance and decomposition. IEEE transactions on evolutionary computation, 19(5):694–716, 2014.
- Pareto domain adaptation. Advances in Neural Information Processing Systems, 34:12917–12929, 2021.
- Pareto multi-task learning. Advances in neural information processing systems, 32, 2019.
- Pareto set learning for neural multi-objective combinatorial optimization. arXiv preprint arXiv:2203.15386, 2022.
- A tri-objective preference-based uniform weight design method using delaunay triangulation. Soft Computing, 25(15):9703–9729, 2021a.
- Profiling pareto front with multi-objective stein variational gradient descent. Advances in Neural Information Processing Systems, 34:14721–14733, 2021b.
- On tchebycheff decomposition approaches for multiobjective evolutionary optimization. IEEE Transactions on Evolutionary Computation, 22(2):226–244, 2017.
- Multi-task learning with user preferences: Gradient descent with controlled ascent in pareto optimization. In International Conference on Machine Learning, pp. 6597–6607. PMLR, 2020.
- Miettinen, K. Nonlinear multiobjective optimization, volume 12. Springer Science & Business Media, 1999.
- A multi-objective/multi-task learning framework induced by pareto stationarity. In International Conference on Machine Learning, pp. 15895–15907. PMLR, 2022.
- Learning the pareto front with hypernetworks. arXiv preprint arXiv:2010.04104, 2020.
- Spatial tessellations: concepts and applications of voronoi diagrams. 2009.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- Moea/d with adaptive weight adjustment. Evolutionary computation, 22(2):231–264, 2014.
- Space-filling design for nonlinear models. arXiv preprint arXiv:1710.11616, 2017.
- Optimization on pareto sets: On a theory of multi-objective optimization. arXiv preprint arXiv:2308.02145, 2023.
- Scalable pareto front approximation for deep multi-objective learning. In 2021 IEEE international conference on data mining (ICDM), pp. 1306–1311. IEEE, 2021.
- Schott, J. R. Fault tolerant design using single and multicriteria genetic algorithm optimization. 1995.
- Interactive design space exploration and optimization for cad models. ACM Transactions on Graphics (TOG), 36(4):1–14, 2017.
- Multiobjective optimization by decomposition with pareto-adaptive weight vectors. In 2011 Seventh international conference on natural computation, volume 3, pp. 1260–1264. IEEE, 2011.
- A modification to moea/d-de for multiobjective optimization problems with complicated pareto sets. Information Sciences, 213:14–38, 2012.
- Moea/d+ uniform design: A new version of moea/d for optimization problems with many objectives. Computers & Operations Research, 40(6):1648–1660, 2013.
- An easy-to-use real-world multi-objective optimization problem suite. Applied Soft Computing, 89:106078, 2020.
- Telgarsky, M. Deep learning theory lecture notes. https://mjt.cs.illinois.edu/dlt/, 2021. Version: 2021-10-27 v0.0-e7150f2d (alpha).
- Vershynin, R. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.
- Multi-objective evolutionary optimisation for product design and manufacturing. Springer, 2011.
- Adaptive weights generation for decomposition-based multi-objective optimization using gaussian process regression. In Proceedings of the Genetic and Evolutionary Computation Conference, pp. 641–648, 2017.
- Fair and optimal classification via post-processing. In International Conference on Machine Learning, pp. 37977–38012. PMLR, 2023.
- Prediction-guided multi-objective reinforcement learning for continuous robot control. In International conference on machine learning, pp. 10607–10616. PMLR, 2020.
- Multi-objective graph heuristic search for terrestrial robot design. In 2021 IEEE international conference on robotics and automation (ICRA), pp. 9863–9869. IEEE, 2021.
- Pareto navigation gradient descent: a first-order algorithm for optimization in pareto set. In Uncertainty in Artificial Intelligence, pp. 2246–2255. PMLR, 2022.
- Moea/d: A multiobjective evolutionary algorithm based on decomposition. IEEE Transactions on evolutionary computation, 11(6):712–731, 2007.
- Rm-meda: A regularity model-based multiobjective estimation of distribution algorithm. IEEE Transactions on Evolutionary Computation, 12(1):41–63, 2008.
- Hypervolume maximization: A geometric view of pareto set learning. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
- Inherent tradeoffs in learning fair representations. The Journal of Machine Learning Research, 23(1):2527–2552, 2022.
- ε𝜀\varepsilonitalic_ε-pal: an active learning approach to the multi-objective optimization problem. The Journal of Machine Learning Research, 17(1):3619–3650, 2016.
- Xiaoyuan Zhang (57 papers)
- Xi Lin (135 papers)
- Yichi Zhang (184 papers)
- Yifan Chen (164 papers)
- Qingfu Zhang (78 papers)