Learning Traveling Solitary Waves Using Separable Gaussian Neural Networks (2403.04883v1)
Abstract: In this paper, we apply a machine-learning approach to learn traveling solitary waves across various families of partial differential equations (PDEs). Our approach integrates a novel interpretable neural network (NN) architecture, called Separable Gaussian Neural Networks (SGNN) into the framework of Physics-Informed Neural Networks (PINNs). Unlike the traditional PINNs that treat spatial and temporal data as independent inputs, the present method leverages wave characteristics to transform data into the so-called co-traveling wave frame. This adaptation effectively addresses the issue of propagation failure in PINNs when applied to large computational domains. Here, the SGNN architecture demonstrates robust approximation capabilities for single-peakon, multi-peakon, and stationary solutions within the (1+1)-dimensional, $b$-family of PDEs. In addition, we expand our investigations, and explore not only peakon solutions in the $ab$-family but also compacton solutions in (2+1)-dimensional, Rosenau-Hyman family of PDEs. A comparative analysis with MLP reveals that SGNN achieves comparable accuracy with fewer than a tenth of the neurons, underscoring its efficiency and potential for broader application in solving complex nonlinear PDEs.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics 2019, 378, 686–707.
- Physics-informed machine learning. Nature Reviews Physics 2021, 3, 422–440.
- Physics-informed neural networks for heat transfer Problems. Journal of Heat Transfer 2021, 143, 060801.
- NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations. Journal of Computational Physics 2021, 426, 109951.
- Asymptotic self-similar blow-up profile for three-dimensional axisymmetric euler equations Using Neural Networks. Phys. Rev. Lett. 2023, 130, 244002.
- Neural networks enforcing physical symmetries in nonlinear dynamical lattices: The case example of the Ablowitz–Ladik model. Physica D 2022, 434, 133264.
- Physics-informed neural networks for myocardial perfusion mri quantification. Medical Image Analysis 2022, 78, 102399.
- Understanding and mitigating gradient flow pathologies in physics-informed neural networks. SIAM Journal on Scientific Computing 2021, 43, A3055–A3081.
- When and why PINNs fail to train: A neural tangent kernel perspective. Journal of Computational Physics 2022, 449, 110768.
- Characterizing possible failure modes in physics-informed neural networks. Advances in Neural Information Processing Systems 2021, 34.
- Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Sampling. In Proceedings of the ICML’23: Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, July 2023; p. 7264–7302.
- An integrable shallow water equation with peaked solitons. Phys. Rev. Lett. 1993, 71, 1661–1664.
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. NeurIPS 2020.
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 2023, 403(A), 115671.
- Respecting causality is all you need for training physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 2024, 421, 116813.
- Data-driven peakon and periodic peakon solutions and parameter discovery of some nonlinear dispersive equations via deep learning. Physica D 2021, 428, 133037 (15 pages).
- Braga-Neto, U. Characteristics-informed neural networks for forward and inverse hyperbolic problems. [arXiv:quant-ph/2212.14012].
- Nonlinear balance and exchange of stability in dynamics of solitons, peakons, ramps/cliffs and leftons in a 1+1 nonlinear evolutionary PDE. Physics Letters A 2003, 308, 437–444.
- An ab-family of the equation with peakon traveling waves. Proceeding of the American Mathematical Society 2016, 144, 3797–3811.
- A new integrable equation with peakon solutions. Theoretical and Mathematical Physics 2002, 133, 1463–1474.
- Symplectic structures, their Bäcklund transformations and hereditary symmetries. Physica D: Nonlinear Phenomena 1981, 4, 47–66.
- Multidimensional Compactons. Physical Review Letters 2007, 98, 024101.
- Rosenau, P. Compact and noncompact dispersive patterns. Physics Letters, Section A: General, Atomic and Solid State Physics 2000, 275, 193–203.
- Separable Gaussian Neural Networks: Structure, analysis, and function approximations. Algorithms 2023, 16, 453 (19 pages).
- Universal approximation using Radial-Basis-Function Networks. Neural Computation 1991, 3, 246–257.
- Adam: A Method for Stochastic Optimization. In Proceedings of the ICLR (Poster), 2015.
- On the limited memory BFGS method for large scale optimization. Mathematical programming 1989, 45, 503–528.
- Kodama, Y. Normal forms for weakly dispersive wave equations. Physics Letters A 1985, 112, 193–196.
- Kodama, Y. On integrable systems with higher order corrections. Physics Letters A 1985, 107, 245–249.
- A new integrable shallow water equation; Elsevier, 1994; Vol. 31, Advances in Applied Mechanics, pp. 1–33.
- The stability of the b-family of peakon equations. Nonlinearity 2023, 36, 1192–1217.
- The Nonlinear Schrödinger Equation; Springer-Verlag (New York), 1999.
- A spectral analysis of the nonlinear Schrödinger equation in the co-exploding frame. Physica D: Nonlinear Phenomena 2022, 439, 133396.
- Self-similar blow-up solutions in the generalized Korteweg-de Vries equation: Spectral analysis, normal form and asymptotics. [arXiv:nlin.PS/2310.13770].