2000 character limit reached
Separable Hamiltonian Neural Networks (2309.01069v4)
Published 3 Sep 2023 in cs.LG and cs.AI
Abstract: Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive separability of the Hamiltonian reduces the regression complexity and improves regression performance. We propose separable HNNs that embed additive separability within HNNs using observational, learning, and inductive biases. We show that the proposed models are more effective than the HNN at regressing the Hamiltonian and the vector field. Consequently, the proposed models predict the dynamics and conserve the total energy of the Hamiltonian system more accurately.
- K. R. Meyer and G. R. Hall, Hamiltonian differential equations and the n-body problem, in Introduction to Hamiltonian Dynamical Systems and the N-Body Problem (Springer New York, New York, NY, 1992) pp. 1–32.
- Y. D. Zhong, B. Dey, and A. Chakraborty, Symplectic ode-net: Learning hamiltonian dynamics with control, in International Conference on Learning Representations (2020).
- M. Toda, Vibration of a chain with nonlinear interaction, Journal of the Physical Society of Japan 22, 431 (1967), https://doi.org/10.1143/JPSJ.22.431 .
- J. Ford, S. D. Stoddard, and J. S. Turner, On the Integrability of the Toda Lattice, Progress of Theoretical Physics 50, 1547 (1973).
- M. Henon and C. Heiles, The applicability of the third integral of motion: Some numerical experiments, The Astronomical Journal 69, 73 (1964).
- D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980 (2014).