Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Solving PDE-constrained Control Problems Using Operator Learning (2111.04941v3)

Published 9 Nov 2021 in math.OC, cs.AI, cs.LG, cs.NA, math.NA, and physics.comp-ph

Abstract: The modeling and control of complex physical systems are essential in real-world problems. We propose a novel framework that is generally applicable to solving PDE-constrained optimal control problems by introducing surrogate models for PDE solution operators with special regularizers. The procedure of the proposed framework is divided into two phases: solution operator learning for PDE constraints (Phase 1) and searching for optimal control (Phase 2). Once the surrogate model is trained in Phase 1, the optimal control can be inferred in Phase 2 without intensive computations. Our framework can be applied to both data-driven and data-free cases. We demonstrate the successful application of our method to various optimal control problems for different control variables with diverse PDE constraints from the Poisson equation to Burgers' equation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. The FEniCS project version 1.5. Archive of Numerical Software, 3(100).
  2. A unified deep artificial neural network approach to partial differential equations in complex geometries. Neurocomputing, 317: 28–41.
  3. Prediction of aerodynamic flow fields using convolutional neural networks. Computational Mechanics, 64(2): 525–545.
  4. Topology optimization of fluids in Stokes flow. International journal for numerical methods in fluids, 41(1): 77–107.
  5. Uniqueness, stability and numerical methods for the inverse problem that arises in financial markets. Inverse problems, 15(3): R95.
  6. Approximations of continuous functionals by neural networks with application to dynamic systems. IEEE Transactions on Neural Networks, 4(6): 910–918.
  7. Nonlinear and robust control of PDE systems: Methods and applications to transport-reaction processes. Appl. Mech. Rev., 55(2): B29–B30.
  8. End-to-end differentiable physics for learning and control. Advances in neural information processing systems, 31: 7178–7189.
  9. Tikhonov regularization applied to the inverse problem of option pricing: convergence analysis and rates. Inverse Problems, 21(3): 1027.
  10. Efficient and accurate estimation of lipschitz constants for deep neural networks. arXiv preprint arXiv:1906.04893.
  11. Gunzburger, M. D. 2002. Perspectives in flow control and optimization. SIAM.
  12. Convolutional neural networks for steady flow approximation. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 481–490.
  13. Learning latent dynamics for planning from pixels. In International Conference on Machine Learning, 2555–2565. PMLR.
  14. Solving high-dimensional partial differential equations using deep learning. Proceedings of the National Academy of Sciences, 115(34): 8505–8510.
  15. Introduction to shape optimization: theory, approximation, and computation. SIAM.
  16. Optimization with PDE constraints, volume 23. Springer Science & Business Media.
  17. Learning to control pdes with differentiable physics. arXiv preprint arXiv:2001.07457.
  18. Trend to equilibrium for the kinetic Fokker-Planck equation via the neural network approach. Journal of Computational Physics, 419: 109665.
  19. Deep neural network approach to forward-inverse problems. Networks & Heterogeneous Media, 15(2): 247.
  20. Solving parametric PDE problems with artificial neural networks. arXiv preprint arXiv:1707.03351.
  21. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114.
  22. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895.
  23. Neural operator: Graph kernel network for partial differential equations. arXiv preprint arXiv:2003.03485.
  24. Differentiable Cloth Simulation for Inverse Problems. In Wallach, H.; Larochelle, H.; Beygelzimer, A.; d'Alché-Buc, F.; Fox, E.; and Garnett, R., eds., Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc.
  25. Lions, J. 1971. Optimal Control of Systems Governed by Partial Differential Equations:. Grundlehren der mathematischen Wissenschaften in Einzeldarstellungen mit besonderer Berücksichtigung der Anwendungsgebiete. Springer-Verlag. ISBN 9783540051152.
  26. Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv preprint arXiv:1910.03193.
  27. Deep learning for universal linear embeddings of nonlinear dynamics. Nature communications, 9(1): 1–10.
  28. Probabilistic representation and inverse design of metamaterials based on a deep generative model with semi-supervised learning strategy. Advanced Materials, 31(35): 1901111.
  29. Fluid control using the adjoint method. ACM Transactions On Graphics (TOG), 23(3): 449–456.
  30. dolfin-adjoint 2018.1: automated adjoints for FEniCS and Firedrake. Journal of Open Source Software, 4(38): 1292.
  31. Deep Dynamical Modeling and Control of Unsteady Fluid Flows. In Bengio, S.; Wallach, H.; Larochelle, H.; Grauman, K.; Cesa-Bianchi, N.; and Garnett, R., eds., Advances in Neural Information Processing Systems, volume 31. Curran Associates, Inc.
  32. A deep neural network surrogate for high-dimensional random partial differential equations. arXiv preprint arXiv:1806.02957.
  33. Pytorch: An imperative style, high-performance deep learning library. arXiv preprint arXiv:1912.01703.
  34. Machine learning inverse problem for topological photonics. Communications Physics, 1(1): 1–7.
  35. Pironneau, O. 1974. On optimum design in fluid mechanics. Journal of Fluid Mechanics, 64(1): 97–110.
  36. Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow control. Journal of fluid mechanics, 865: 281–302.
  37. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378: 686–707.
  38. Benchmarking deep inverse models over time, and the neural-adjoint method. arXiv preprint arXiv:2009.12919.
  39. DGM: A deep learning algorithm for solving partial differential equations. Journal of computational physics, 375: 1339–1364.
  40. Introduction to shape optimization. In Introduction to Shape Optimization, 5–12. Springer.
  41. Sobolev Training for the Neural Network Solutions of PDEs. arXiv preprint arXiv:2101.08932.
  42. Tröltzsch, F. 2010. Optimal control of partial differential equations: theory, methods, and applications, volume 112. American Mathematical Soc.
  43. Lipschitz regularity of deep neural networks: analysis and efficient estimation. In Bengio, S.; Wallach, H.; Larochelle, H.; Grauman, K.; Cesa-Bianchi, N.; and Garnett, R., eds., Advances in Neural Information Processing Systems, volume 31. Curran Associates, Inc.
  44. Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images. In Cortes, C.; Lawrence, N.; Lee, D.; Sugiyama, M.; and Garnett, R., eds., Advances in Neural Information Processing Systems, volume 28. Curran Associates, Inc.
  45. The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6(1): 1–12.
  46. Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification. Journal of Computational Physics, 366: 415–447.
  47. Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data. Journal of Computational Physics, 394: 56–81.
Citations (36)

Summary

We haven't generated a summary for this paper yet.