Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning Traveling Solitary Waves Using Separable Gaussian Neural Networks (2403.04883v1)

Published 7 Mar 2024 in nlin.PS and cs.LG

Abstract: In this paper, we apply a machine-learning approach to learn traveling solitary waves across various families of partial differential equations (PDEs). Our approach integrates a novel interpretable neural network (NN) architecture, called Separable Gaussian Neural Networks (SGNN) into the framework of Physics-Informed Neural Networks (PINNs). Unlike the traditional PINNs that treat spatial and temporal data as independent inputs, the present method leverages wave characteristics to transform data into the so-called co-traveling wave frame. This adaptation effectively addresses the issue of propagation failure in PINNs when applied to large computational domains. Here, the SGNN architecture demonstrates robust approximation capabilities for single-peakon, multi-peakon, and stationary solutions within the (1+1)-dimensional, $b$-family of PDEs. In addition, we expand our investigations, and explore not only peakon solutions in the $ab$-family but also compacton solutions in (2+1)-dimensional, Rosenau-Hyman family of PDEs. A comparative analysis with MLP reveals that SGNN achieves comparable accuracy with fewer than a tenth of the neurons, underscoring its efficiency and potential for broader application in solving complex nonlinear PDEs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics 2019, 378, 686–707.
  2. Physics-informed machine learning. Nature Reviews Physics 2021, 3, 422–440.
  3. Physics-informed neural networks for heat transfer Problems. Journal of Heat Transfer 2021, 143, 060801.
  4. NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations. Journal of Computational Physics 2021, 426, 109951.
  5. Asymptotic self-similar blow-up profile for three-dimensional axisymmetric euler equations Using Neural Networks. Phys. Rev. Lett. 2023, 130, 244002.
  6. Neural networks enforcing physical symmetries in nonlinear dynamical lattices: The case example of the Ablowitz–Ladik model. Physica D 2022, 434, 133264.
  7. Physics-informed neural networks for myocardial perfusion mri quantification. Medical Image Analysis 2022, 78, 102399.
  8. Understanding and mitigating gradient flow pathologies in physics-informed neural networks. SIAM Journal on Scientific Computing 2021, 43, A3055–A3081.
  9. When and why PINNs fail to train: A neural tangent kernel perspective. Journal of Computational Physics 2022, 449, 110768.
  10. Characterizing possible failure modes in physics-informed neural networks. Advances in Neural Information Processing Systems 2021, 34.
  11. Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Sampling. In Proceedings of the ICML’23: Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, July 2023; p. 7264–7302.
  12. An integrable shallow water equation with peaked solitons. Phys. Rev. Lett. 1993, 71, 1661–1664.
  13. Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. NeurIPS 2020.
  14. A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 2023, 403(A), 115671.
  15. Respecting causality is all you need for training physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 2024, 421, 116813.
  16. Data-driven peakon and periodic peakon solutions and parameter discovery of some nonlinear dispersive equations via deep learning. Physica D 2021, 428, 133037 (15 pages).
  17. Braga-Neto, U. Characteristics-informed neural networks for forward and inverse hyperbolic problems. [arXiv:quant-ph/2212.14012].
  18. Nonlinear balance and exchange of stability in dynamics of solitons, peakons, ramps/cliffs and leftons in a 1+1 nonlinear evolutionary PDE. Physics Letters A 2003, 308, 437–444.
  19. An ab-family of the equation with peakon traveling waves. Proceeding of the American Mathematical Society 2016, 144, 3797–3811.
  20. A new integrable equation with peakon solutions. Theoretical and Mathematical Physics 2002, 133, 1463–1474.
  21. Symplectic structures, their Bäcklund transformations and hereditary symmetries. Physica D: Nonlinear Phenomena 1981, 4, 47–66.
  22. Multidimensional Compactons. Physical Review Letters 2007, 98, 024101.
  23. Rosenau, P. Compact and noncompact dispersive patterns. Physics Letters, Section A: General, Atomic and Solid State Physics 2000, 275, 193–203.
  24. Separable Gaussian Neural Networks: Structure, analysis, and function approximations. Algorithms 2023, 16, 453 (19 pages).
  25. Universal approximation using Radial-Basis-Function Networks. Neural Computation 1991, 3, 246–257.
  26. Adam: A Method for Stochastic Optimization. In Proceedings of the ICLR (Poster), 2015.
  27. On the limited memory BFGS method for large scale optimization. Mathematical programming 1989, 45, 503–528.
  28. Kodama, Y. Normal forms for weakly dispersive wave equations. Physics Letters A 1985, 112, 193–196.
  29. Kodama, Y. On integrable systems with higher order corrections. Physics Letters A 1985, 107, 245–249.
  30. A new integrable shallow water equation; Elsevier, 1994; Vol. 31, Advances in Applied Mechanics, pp. 1–33.
  31. The stability of the b-family of peakon equations. Nonlinearity 2023, 36, 1192–1217.
  32. The Nonlinear Schrödinger Equation; Springer-Verlag (New York), 1999.
  33. A spectral analysis of the nonlinear Schrödinger equation in the co-exploding frame. Physica D: Nonlinear Phenomena 2022, 439, 133396.
  34. Self-similar blow-up solutions in the generalized Korteweg-de Vries equation: Spectral analysis, normal form and asymptotics. [arXiv:nlin.PS/2310.13770].

Summary

We haven't generated a summary for this paper yet.

Youtube Logo Streamline Icon: https://streamlinehq.com