torchmSAT: A GPU-Accelerated Approximation To The Maximum Satisfiability Problem (2402.03640v1)
Abstract: The remarkable achievements of machine learning techniques in analyzing discrete structures have drawn significant attention towards their integration into combinatorial optimization algorithms. Typically, these methodologies improve existing solvers by injecting learned models within the solving loop to enhance the efficiency of the search process. In this work, we derive a single differentiable function capable of approximating solutions for the Maximum Satisfiability Problem (MaxSAT). Then, we present a novel neural network architecture to model our differentiable function, and progressively solve MaxSAT using backpropagation. This approach eliminates the need for labeled data or a neural network training phase, as the training process functions as the solving algorithm. Additionally, we leverage the computational power of GPUs to accelerate these computations. Experimental results on challenging MaxSAT instances show that our proposed methodology outperforms two existing MaxSAT solvers, and is on par with another in terms of solution cost, without necessitating any training or access to an underlying SAT solver. Given that numerous NP-hard problems can be reduced to MaxSAT, our novel technique paves the way for a new generation of solvers poised to benefit from neural network GPU acceleration.
- Shmuel Agmon. The relaxation method for linear inequalities. Canadian Journal of Mathematics, 6:382–392, 1954.
- Miklos Ajtai. Parity and the pigeonhole principle. In Feasible Mathematics: A Mathematical Sciences Institute Workshop, Ithaca, New York, June 1989, pages 1–24. Springer, 1990.
- Michael Alekhnovich. Mutilated chessboard problem is exponentially hard for resolution. Theoretical Computer Science, 310(1-3):513–525, 2004.
- A differentiable approach to the maximum independent set problem using dataless neural networks. Neural Networks, 155:168–176, 2022.
- SAT-based MaxSAT algorithms. Artificial Intelligence, 196:77–105, 2013.
- On the glucose SAT solver. International Journal on Artificial Intelligence Tools, 27(01):1840001, 2018.
- Neural combinatorial optimization with reinforcement learning. arXiv preprint arXiv:1611.09940, 2016.
- Machine learning for combinatorial optimization: a methodological tour d’horizon. European Journal of Operational Research, 290(2):405–421, 2021.
- Learning MAX-SAT models from examples using genetic algorithms and knowledge compilation. In 28th International Conference on Principles and Practice of Constraint Programming (CP 2022). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2022.
- Handbook of satisfiability, volume 185. IOS press, 2009.
- The relative efficiency of propositional proof systems. The journal of symbolic logic, 44(1):36–50, 1979.
- CaDiCaL, kissat, paracooba, plingeling and treengeling entering the sat competition 2020. SAT COMPETITION, 2020:50, 2020.
- Exact combinatorial optimization with graph convolutional neural networks. Advances in neural information processing systems, 32, 2019.
- Branch & learn for recursively and iteratively solvable problems in predict+ optimize. Advances in Neural Information Processing Systems, 35:25807–25817, 2022.
- PySAT: A Python toolkit for prototyping with SAT oracles. In SAT, pages 428–437, 2018. doi: 10.1007/978-3-319-94144-8_26. URL https://doi.org/10.1007/978-3-319-94144-8_26.
- RC2: an efficient maxsat solver. Journal on Satisfiability, Boolean Modeling and Computation, 11(1):53–64, 2019.
- Efficient sat-based bounded model checking for software verification. Theoretical Computer Science, 404(3):256–274, 2008.
- Richard M. Karp. Reducibility among Combinatorial Problems. In Raymond E. Miller, James W. Thatcher, and Jean D. Bohlinger, editors, Complexity of Computer Computations, pages 85–103. Springer US, Boston, MA, 1972. ISBN 978-1-4684-2001-2. doi: 10.1007/978-1-4684-2001-2_9.
- Learning combinatorial optimization algorithms over graphs. Advances in neural information processing systems, 30, 2017a.
- Learning to run heuristics in tree search. In IJCAI, pages 659–666, 2017b.
- Attention, learn to solve routing problems! arXiv preprint arXiv:1803.08475, 2018.
- Balakrishnan Krishnamurthy. Short proofs for tricky formulas. Acta informatica, 22:253–275, 1985.
- Learning MAX-SAT from contextual examples for combinatorial optimisation. Artificial Intelligence, 314:103794, 2023.
- Boosting branch-and-bound MaxSAT solvers with clause learning. AI Communications, 35(2):131–151, 2022.
- NSNet: A General Neural Probabilistic Framework for Satisfiability Problems. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 25573–25585. Curran Associates, Inc., 2022. URL https://proceedings.neurips.cc/paper_files/paper/2022/file/a40462acc6959034c6aa6dfb8e696415-Paper-Conference.pdf.
- Combinatorial optimization with graph convolutional networks and guided tree search. Advances in neural information processing systems, 31, 2018.
- Algorithms for weighted boolean optimization. In Theory and Applications of Satisfiability Testing-SAT 2009: 12th International Conference, SAT 2009, Swansea, UK, June 30-July 3, 2009. Proceedings 12, pages 495–508. Springer, 2009.
- Raffaele Marino. Learning from survey propagation: a neural network for max-e-3-sat. Machine Learning: Science and Technology, 2(3):035032, 2021.
- Incremental cardinality constraints for maxsat. In Principles and Practice of Constraint Programming: 20th International Conference, CP 2014, Lyon, France, September 8-12, 2014. Proceedings 20, pages 531–548. Springer, 2014.
- Reinforcement learning for combinatorial optimization: A survey. Computers & Operations Research, 134:105400, 2021.
- Iterative and core-guided MaxSAT solving: A survey and assessment. Constraints, 18:478–534, 2013.
- Core-guided MaxSAT with soft cardinality constraints. In Principles and Practice of Constraint Programming: 20th International Conference, CP 2014, Lyon, France, September 8-12, 2014. Proceedings 20, pages 564–573. Springer, 2014a.
- MSCG: Robust core-guided MaxSAT solving. Journal on Satisfiability, Boolean Modeling and Computation, 9(1):129–134, 2014b.
- Solving SAT and SAT modulo theories: From an abstract davis–putnam–logemann–loveland procedure to dpll (t). Journal of the ACM (JACM), 53(6):937–977, 2006.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- Combinatorial optimization with physics-inspired graph neural networks. Nature Machine Intelligence, 4(4):367–377, 2022.
- Guiding high-performance SAT solvers with unsat-core predictions. In Theory and Applications of Satisfiability Testing–SAT 2019: 22nd International Conference, SAT 2019, Lisbon, Portugal, July 9–12, 2019, Proceedings 22, pages 336–353. Springer, 2019.
- Learning a SAT solver from single-bit supervision. In International Conference on Learning Representations, 2019. URL https://openreview.net/forum?id=HJMC_iA5tm.
- PMTP: A MAX-SAT-based approach to detect hardware trojan using propagation of maximum transition probability. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 39(1):25–33, 2018.
- Maximum satisfiability in software analysis: Applications and techniques. In Computer Aided Verification: 29th International Conference, CAV 2017, Heidelberg, Germany, July 24-28, 2017, Proceedings, Part I 30, pages 68–94. Springer, 2017.
- Minisat v1. 13-a sat solver with conflict-clause minimization. SAT, 53(2005):1–2, 2005.
- Finding a maximum independent set. SIAM Journal on Computing, 6(3):537–546, 1977.
- Learning branching heuristics for propositional model counting. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 12427–12435, 2021.
- A bi-level framework for learning to solve combinatorial optimization on graphs. Advances in Neural Information Processing Systems, 34:21453–21466, 2021.