Convergence of weak-SINDy Surrogate Models (2209.15573v3)
Abstract: In this paper, we give an in-depth error analysis for surrogate models generated by a variant of the Sparse Identification of Nonlinear Dynamics (SINDy) method. We start with an overview of a variety of non-linear system identification techniques, namely, SINDy, weak-SINDy, and the occupation kernel method. Under the assumption that the dynamics are a finite linear combination of a set of basis functions, these methods establish a matrix equation to recover coefficients. We illuminate the structural similarities between these techniques and establish a projection property for the weak-SINDy technique. Following the overview, we analyze the error of surrogate models generated by a simplified version of weak-SINDy. In particular, under the assumption of boundedness of a composition operator given by the solution, we show that (i) the surrogate dynamics converges towards the true dynamics and (ii) the solution of the surrogate model is reasonably close to the true solution. Finally, as an application, we discuss the use of a combination of weak-SINDy surrogate modeling and proper orthogonal decomposition (POD) to build a surrogate model for partial differential equations (PDEs).
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 113(15):3932–3937, 2016.
- Spectral methods: fundamentals in single domains. Springer Science & Business Media, 2007.
- Approximation results for orthogonal polynomials in sobolev spaces. Mathematics of Computation, 38(157):67–86, 1982.
- Alain de Cheveigné and Israel Nelken. Filters: When, why, and how (not) to use them. Neuron, 102(2):280–293, 2019.
- Linear operators, part 1: general theory, volume 10. John Wiley & Sons, 1988.
- L. E. Fraenkel. Formulae for high derivatives of composite functions. Mathematical Proceedings of the Cambridge Philosophical Society, 83(2):159–165, 1978.
- Array programming with NumPy. Nature, 585(7825):357–362, September 2020.
- The elements of statistical learning: data mining, inference, and prediction, volume 2. Springer, 2009.
- Turbulence, coherent structures, dynamical systems and symmetry. Cambridge university press, 2012.
- Dynamic mode decomposition: data-driven modeling of complex systems. SIAM, 2016.
- Randall J LeVeque et al. Finite volume methods for hyperbolic problems, volume 31. Cambridge university press, 2002.
- Lennart Ljung. System identification. In Signal analysis and prediction, pages 163–173. Springer, 1998.
- An introduction to the pod galerkin method for fluid flows with analytical examples and matlab source codes. Berlin Institute of Technology MB1, Muller-Breslau-Strabe, 11, 2009.
- Weak sindy for partial differential equations. Journal of Computational Physics, 443:110525, 2021.
- Weak sindy: Galerkin-based data-driven model selection. Multiscale Modeling & Simulation, 19(3):1474–1497, 2021.
- Suresh Muthukumaraswamy. High-frequency brain activity and muscle artifacts in meg/eeg: A review and recommendations. Frontiers in Human Neuroscience, 7, 2013.
- An introduction to the theory of reproducing kernel Hilbert spaces, volume 152. Cambridge University Press, 2016.
- Reduced operator inference for nonlinear partial differential equations. SIAM Journal on Scientific Computing, 44(4):A1934–A1959, 2022.
- Dynamic mode decomposition for continuous time systems with the liouville operator. Journal of Nonlinear Science, 32(1):1–30, 2022.
- Occupation kernels and densely defined Liouville operators for system identification. In Proc. IEEE Conf. Decis. Control, pages 6455–6460, December 2019.
- The occupation kernel method for nonlinear system identification. arXiv preprint arXiv:1909.11792, 2019.
- Liouville operators over the hardy space. Journal of Mathematical Analysis and Applications, 508(2):125854, 2022.
- Lawrence Sirovich. Turbulence and the dynamics of coherent structures. i. coherent structures. Quarterly of applied mathematics, 45(3):561–571, 1987.
- Joseph Smagorinsky. General circulation experiments with the primitive equations: I. the basic experiment. Monthly weather review, 91(3):99–164, 1963.
- Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267–288, 1996.
- SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17:261–272, 2020.
- Musheng Wei. Perturbation of the least squares problem. Linear Algebra and its Applications, 141:177–182, 1990.
- On the convergence of the sindy algorithm. Multiscale Modeling & Simulation, 17(3):948–972, 2019.