Machine-learning invariant foliations in forced systems for reduced order modelling (2403.14514v1)
Abstract: We identify reduced order models (ROM) of forced systems from data using invariant foliations. The forcing can be external, parametric, periodic or quasi-periodic. The process has four steps: 1. identify an approximate invariant torus and the linear dynamics about the torus; 2. identify a globally defined invariant foliation about the torus; 3. identify a local foliation about an invariant manifold that complements the global foliation 4. extract the invariant manifold as the leaf going through the torus and interpret the result. We combine steps 2 and 3, so that we can track the location of the invariant torus and scale the invariance equations appropriately. We highlight some fundamental limitations of invariant manifolds and foliations when fitting them to data, that require further mathematics to resolve.
- B. Aulbach. The fundamental existence theorem on invariant fiber bundles. Journal of Difference Equations and Applications, 3(5-6):267–312, 1998.
- Algorithm 432 [c2]: Solution of the matrix equation ax + xb = c [f4]. Commun. ACM, 15(9):820–826, 1972.
- Invariant foliations near normally hyperbolic invariant manifolds for semiflows. Trans. Amer. Math. Soc., 352(10):4641–4676, 2000.
- G. Biau and L. Devroye. Lectures on the Nearest Neighbor Method. Springer Series in the Data Sciences. Springer, 2015.
- S. Boyd and L. Vandenberghe. Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares. Cambridge University Press, 2018.
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences of the United States of America, 113(15):3932–3937, 2016.
- The parameterization method for invariant manifolds I: Manifolds associated to non-resonant subspaces. Indiana Univ. Math. J., 52:283–328, 2003.
- Discovering causal relations and equations from data. Physics Reports, 1044:1–68, 2023.
- Data-driven modeling and prediction of non-linearizable dynamics via spectral submanifolds. Nat Commun, 13(872), 2022.
- Data-driven discovery of coordinates and governing equations. Proceedings of the National Academy of Sciences of the United States of America, 116(45):22445–22451, 2019.
- C. Chicone. Ordinary Differential Equations with Applications. Texts in Applied Mathematics. Springer New York, 2008.
- R. de la Llave. Invariant manifolds associated to nonresonant spectral subspaces. Journal of Statistical Physics, 87(1):211–249, 1997.
- On irwin’s proof of the pseudostable manifold theorem. Mathematische Zeitschrift, 219:301–321, 1995.
- J. M. Epstein. Why model? Journal of Artificial Societies and Social Simulation, 11(4):12, 2008.
- The Parameterization Method for Invariant Manifolds: From Rigorous Results to Effective Computations, volume 195 of Applied Mathematical Sciences. Springer, 2016.
- Invariant manifolds. Bull. Amer. Math. Soc., 76(5):1015–1019, 09 1970.
- Equation-free, coarse-grained multiscale computation: enabling microscopic simulators to perform system-level analysis. Communications in Mathematical Sciences, 1(4):715–762, 2003.
- M. A. Kramer. Nonlinear principal component analysis using autoassociative neural networks. AIChE Journal, 37(2):233–243, 1991.
- H. Blaine Lawson, Jr. Foliations. Bull. Amer. Math. Soc., 80:369–418, 1974.
- Coordinate descent converges faster with the gauss-southwell rule than random selection. In Proceedings of the 32nd International Conference on International Conference on Machine Learning - Volume 37, ICML’15, pages 1632–1641, 2015.
- Exciting traffic jams: Nonlinear phenomena behind traffic jam formation on highways. Phys. Rev. E, 80:046205, Oct 2009.
- Hölder foliations, revisited, 2012.
- A. J. Roberts. Appropriate initial conditions for asymptotic descriptions of the long-term evolution of dynamical systems. J. Austral. Math. Soc. Ser. B, 31:48–75, 1989.
- C.E. Shannon. Communication in the presence of noise. Proceedings of the IRE, 37(1):10–21, 1949.
- S. W. Shaw and C Pierre. Normal-modes of vibration for nonlinear continuous systems. J. Sound Vibr., 169(3):319–347, 1994.
- R. Szalai. Invariant spectral foliations with applications to model order reduction and synthesis. Nonlinear Dynamics, 101(4):2645–2669, 2020.
- R. Szalai. Data-driven reduced order models using invariant foliations, manifolds and autoencoders. Journal of Nonlinear Science, 33(5):75, 2023.
- R. Szalai. Non-resonant invariant foliations of quasi-periodically forced systems, 2024.
- L. N. Trefethen. Spectral Methods in MATLAB. SIAM Philadelphia, 2000.
- S. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos. Texts in Applied Mathematics. Springer New York, 2003.