Papers
Topics
Authors
Recent
Search
2000 character limit reached

MORBDD: Multiobjective Restricted Binary Decision Diagrams by Learning to Sparsify

Published 4 Mar 2024 in cs.AI | (2403.02482v1)

Abstract: In multicriteria decision-making, a user seeks a set of non-dominated solutions to a (constrained) multiobjective optimization problem, the so-called Pareto frontier. In this work, we seek to bring a state-of-the-art method for exact multiobjective integer linear programming into the heuristic realm. We focus on binary decision diagrams (BDDs) which first construct a graph that represents all feasible solutions to the problem and then traverse the graph to extract the Pareto frontier. Because the Pareto frontier may be exponentially large, enumerating it over the BDD can be time-consuming. We explore how restricted BDDs, which have already been shown to be effective as heuristics for single-objective problems, can be adapted to multiobjective optimization through the use of ML. MORBDD, our ML-based BDD sparsifier, first trains a binary classifier to eliminate BDD nodes that are unlikely to contribute to Pareto solutions, then post-processes the sparse BDD to ensure its connectivity via optimization. Experimental results on multiobjective knapsack problems show that MORBDD is highly effective at producing very small restricted BDDs with excellent approximation quality, outperforming width-limited restricted BDDs and the well-known evolutionary algorithm NSGA-II.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (22)
  1. Branch-and-bound for biobjective mixed-integer linear programming. INFORMS Journal on Computing, 34(2):909–933, 2022.
  2. A matheuristic for tri-objective binary integer programming. arXiv preprint arXiv:2205.03386, 2022.
  3. Multiobjective optimization by decision diagrams. In International Conference on Principles and Practice of Constraint Programming, pages 86–95. Springer, 2016.
  4. Decision diagrams for optimization, volume 1. Springer, 2016.
  5. Network models for multiobjective discrete optimization. INFORMS Journal on Computing, 2021.
  6. J. Blank and K. Deb. pymoo: Multi-objective optimization in python. IEEE Access, 8:89497–89509, 2020.
  7. Pymoo: Multi-objective optimization in Python. IEEE Access, 8:89497–89509, 2020.
  8. The triangle splitting method for biobjective mixed integer programming. In Integer Programming and Combinatorial Optimization: 17th International Conference, IPCO 2014, Bonn, Germany, June 23-25, 2014. Proceedings 17, pages 162–173. Springer, 2014.
  9. A criterion space search algorithm for biobjective integer programming: The balanced box method. INFORMS Journal on Computing, 27(4):735–754, 2015.
  10. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, pages 785–794, New York, NY, USA, 2016. ACM.
  11. A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE transactions on evolutionary computation, 6(2):182–197, 2002.
  12. Exact methods for multi-objective combinatorial optimisation. In Multiple Criteria Decision Analysis, pages 817–850. Springer, 2nd edition, 2016.
  13. M. Ehrgott. Multicriteria optimization. Springer Science & Business Media, 2006.
  14. The feasibility pump. Mathematical Programming, 104:91–104, 2005.
  15. Multi-objective gflownets. In International Conference on Machine Learning, pages 14631–14653. PMLR, 2023.
  16. A new algorithm for generating all nondominated solutions of multiobjective discrete optimization problems. European Journal of Operational Research, 232(3):479–488, 2014.
  17. Pareto set learning for expensive multi-objective optimization. Advances in Neural Information Processing Systems, 35:19231–19247, 2022.
  18. Learning the pareto front with hypernetworks. In International Conference on Learning Representations, 2020.
  19. A feasibility pump and local search based heuristic for bi-objective pure integer linear programming. INFORMS Journal on Computing, 31(1):115–133, 2019.
  20. Fpbh: A feasibility pump based heuristic for multi-objective mixed integer linear programming. Computers & Operations Research, 112:104760, 2019.
  21. Enumeration of the nondominated set of multiobjective discrete optimization problems. INFORMS Journal on Computing, 33(1):72–85, 2021.
  22. Graph learning assisted multi-objective integer programming. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 17774–17787. Curran Associates, Inc., 2022.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.