A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions (2310.00177v5)
Abstract: We introduce a neural-preconditioned iterative solver for Poisson equations with mixed boundary conditions. Typical Poisson discretizations yield large, ill-conditioned linear systems. Iterative solvers can be effective for these problems, but only when equipped with powerful preconditioners. Unfortunately, effective preconditioners like multigrid require costly setup phases that must be re-executed every time domain shapes or boundary conditions change, forming a severe bottleneck for problems with evolving boundaries. In contrast, we present a neural preconditioner trained to efficiently approximate the inverse of the discrete Laplacian in the presence of such changes. Our approach generalizes to domain shapes, boundary conditions, and grid sizes outside the training set. The key to our preconditioner's success is a novel, lightweight neural network architecture featuring spatially varying convolution kernels and supporting fast inference. We demonstrate that our solver outperforms state-of-the-art methods like algebraic multigrid as well as recently proposed neural preconditioners on challenging test cases arising from incompressible fluid simulations.
- Machine-learned preconditioners for linear solvers in geophysical fluid flows. arXiv preprint arXiv:2010.02866, 2020.
- Y. Azulay and R. Treister. Multigrid-augmented deep learning preconditioners for the helmholtz equation. SIAM Journal on Scientific Computing, 45(3):S127–S151, 2023. doi: 10.1137/21M1433514. URL https://doi.org/10.1137/21M1433514.
- Nonsymmetric preconditioning for conjugate gradient and steepest descent methods. Procedia Computer Science, 51:276–285, 2015. ISSN 1877-0509. doi: https://doi.org/10.1016/j.procs.2015.05.241. URL https://www.sciencedirect.com/science/article/pii/S1877050915010492. International Conference On Computational Science, ICCS 2015.
- A. Brandt. Multi-level adaptive solutions to boundary-value problems. Math Comp, 31(138):333–390, 1977.
- Algorithm 887: Cholmod, supernodal sparse cholesky factorization and update/downdate. ACM Trans. Math. Softw., 35(3), oct 2008. ISSN 0098-3500. doi: 10.1145/1391989.1391995. URL https://doi.org/10.1145/1391989.1391995.
- Using neural networks to solve the 2d poisson equation for electric field computation in plasma fluid simulations. arXiv preprint arXiv:2109.13076, 2021.
- A. Chorin. A numerical method for solving incompressible viscous flow problems. J Comp Phys, 2(1):12–26, 1967.
- J. Cooley and J. Tukey. An algorithm for the machine calculation of complex fourier series. Math Comp, 19(90):297–301, 1965.
- D. Demidov. Amgcl —a c++ library for efficient solution of large sparse linear systems. Software Impacts, 6:100037, 2020. ISSN 2665-9638. doi: https://doi.org/10.1016/j.simpa.2020.100037. URL https://www.sciencedirect.com/science/article/pii/S2665963820300282.
- Mgic: Multigrid-in-channels neural network architectures. SIAM Journal on Scientific Computing, 45(3):S307–S328, 2023. doi: 10.1137/21M1430194. URL https://doi.org/10.1137/21M1430194.
- G. Golub and C. Van Loan. Matrix computations, volume 3. JHU Press, 2012.
- G. Golub and Q. Ye. Inexact preconditioned conjugate gradient method with inner-outer iteration. SIAM J Sci Comp, 21(4):1305–1320, 1999. doi: 10.1137/S1064827597323415.
- M. Götz and H. Anzt. Machine learning-aided numerical linear algebra: Convolutional neural networks for the efficient preconditioner generation. In 2018 IEEE/ACM 9th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems (scalA), pp. 49–56, 2018. doi: 10.1109/ScalA.2018.00010.
- F. Harlow. The particle-in-cell method for numerical solution of problems in fluid dynamics. Meth Comp Phys, 3:319–343, 1964.
- Learning optimal multigrid smoothers via neural networks. SIAM Journal on Scientific Computing, 45(3):S199–S225, 2023. doi: 10.1137/21M1430030. URL https://doi.org/10.1137/21M1430030.
- A deep conjugate direction method for iteratively solving linear systems. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (eds.), Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pp. 15720–15736. PMLR, 23–29 Jul 2023. URL https://proceedings.mlr.press/v202/kaneda23a.html.
- C. Lanczos. An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. 1950.
- Learning preconditioners for conjugate gradient PDE solvers. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (eds.), Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pp. 19425–19439. PMLR, 23–29 Jul 2023. URL https://proceedings.mlr.press/v202/li23e.html.
- Deep multi-scale video prediction beyond mean square error, 2016.
- Cupy: A numpy-compatible library for nvidia gpu calculations. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Thirty-first Annual Conference on Neural Information Processing Systems (NIPS), 2017. URL http://learningsys.org/nips17/assets/papers/paper_16.pdf.
- Pytorch: An imperative style, high-performance deep learning library. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (eds.), Advances in Neural Information Processing Systems 32, pp. 8024–8035. Curran Associates, Inc., 2019. URL http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf.
- A. Robert. A stable numerical integration scheme for the primitive meteorological equations. Atm Ocean, 19(1):35–46, 1981.
- U-net: Convolutional networks for biomedical image segmentation, 2015.
- Y. Saad. Iterative Methods for Sparse Linear Systems. Society for Industrial and Applied Mathematics, USA, 2nd edition, 2003. ISBN 0898715342.
- Deep learning of preconditioners for conjugate gradient solvers in urban water related problems, 2019. URL https://arxiv.org/abs/1906.06925.
- J.R. Shewchuk. An introduction to the conjugate gradient method without the agonizing pain. Technical report, USA, 1994.
- J. Stam. Stable fluids. In Siggraph, volume 99, pp. 121–128, 1999.
- Accelerating Eulerian fluid simulation with convolutional networks. In D. Precup and Y. Teh (eds.), Proc 34th Int Conf Mach Learn, volume 70 of Proc Mach Learn Res, pp. 3424–3433. PMLR, 06–11 Aug 2017.
- Y. Zhu and R. Bridson. Animating sand as a fluid. ACM Trans Graph, 24(3):965–972, 2005.
- Poisson cnn: Convolutional neural networks for the solution of the poisson equation on a cartesian mesh. Data-Centric Engineering, 2:e6, 2021. doi: 10.1017/dce.2021.7.