Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

LES-SINDy: Laplace-Enhanced Sparse Identification of Nonlinear Dynamical Systems (2411.01719v1)

Published 4 Nov 2024 in math.DS, cs.LG, cs.NA, math.NA, and physics.comp-ph

Abstract: Sparse Identification of Nonlinear Dynamical Systems (SINDy) is a powerful tool for the data-driven discovery of governing equations. However, it encounters challenges when modeling complex dynamical systems involving high-order derivatives or discontinuities, particularly in the presence of noise. These limitations restrict its applicability across various fields in applied mathematics and physics. To mitigate these, we propose Laplace-Enhanced SparSe Identification of Nonlinear Dynamical Systems (LES-SINDy). By transforming time-series measurements from the time domain to the Laplace domain using the Laplace transform and integration by parts, LES-SINDy enables more accurate approximations of derivatives and discontinuous terms. It also effectively handles unbounded growth functions and accumulated numerical errors in the Laplace domain, thereby overcoming challenges in the identification process. The model evaluation process selects the most accurate and parsimonious dynamical systems from multiple candidates. Experimental results across diverse ordinary and partial differential equations show that LES-SINDy achieves superior robustness, accuracy, and parsimony compared to existing methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. \bibcommenthead
  2. Steven L Brunton, J Nathan Kutz. Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press; 2022.
  3. Jose Nathan Kutz. Data-Driven Modeling & Scientific Computation: Methods for Complex Systems & Big Data. OUP Oxford; 2013.
  4. Discovering Governing Equations from Data by Sparse Identification of Nonlinear Dynamical Systems. Proceedings of the National Academy of Sciences. 2016;113(15):3932–3937.
  5. An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint. Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences. 2004;57(11):1413–1457.
  6. Hayden Schaeffer. Learning Partial Differential Equations via Data Discovery and Sparse Optimization. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2017;473(2197):20160446.
  7. Data-Driven Discovery of Partial Differential Equations. Science Advances. 2017;3(4):e1602614.
  8. Data-Driven Identification of Parametric Partial Differential Equations. SIAM Journal on Applied Dynamical Systems. 2019;18(2):643–660.
  9. Sparse Identification of Nonlinear Dynamics with Control (SINDyc). IFAC-PapersOnLine. 2016;49(18):710–715.
  10. Sparse Identification of Nonlinear Dynamics for Model Predictive Control in the Low-Data Limit. Proceedings of the Royal Society A. 2018;474(2219):20180335.
  11. Sheng Zhang, Guang Lin. Robust Data-Driven Discovery of Governing Physical Laws with Error Bars. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2018;474(2217):20180305.
  12. SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamics. Proceedings of the Royal Society A. 2020;476(2242):20200279.
  13. Hirotugu Akaike. A New Look at the Statistical Model Identification. IEEE Transactions on Automatic Control. 1974;19(6):716–723.
  14. Gideon Schwarz. Estimating the Dimension of a Model. The Annals of Statistics. 1978;p. 461–464.
  15. Hirotogu Akaike. Information Theory and an Extension of the Maximum Likelihood Principle. Selected Papers of Hirotugu Akaike. 1998;p. 199–213.
  16. Model selection for dynamical systems via sparse regression and information criteria. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2017;473(2204):20170009.
  17. Data-Driven Discovery of Coordinates and Governing Equations. Proceedings of the National Academy of Sciences. 2019;116(45):22445–22451.
  18. Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. Journal of Computational physics. 2019;378:686–707.
  19. Maziar Raissi. Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations. Journal of Machine Learning Research. 2018;19(25):1–24.
  20. Physics-Informed Learning of Governing Equations from Scarce Data. Nature Communications. 2021;12(1):6136.
  21. Daniel Floryan, Michael D Graham. Data-Driven Discovery of Intrinsic Dynamics. Nature Machine Intelligence. 2022;4(12):1113–1120.
  22. PySINDy: A Python Package for the Sparse Identification of Nonlinear Dynamical Systems from Data. Journal of Open Source Software. 2020;5(49):2104.
  23. PySINDy: A Comprehensive Python Package for Robust Sparse System Identification. Journal of Open Source Software. 2022;7(69):3994.
  24. Ivan Markovsky, Florian Dörfler. Behavioral Systems Theory in Data-Driven Analysis, Signal Processing, And Control. Annual Reviews in Control. 2021;52:42–64.
  25. SINDy with Control: A Tutorial. In: IEEE Conference on Decision and Control. IEEE; 2021. p. 16–21.
  26. Machine Learning for Fluid Mechanics. Annual Review of Fluid Mechanics. 2020;52(1):477–508.
  27. Data-Driven Causal Model Discovery and Personalized Prediction in Alzheimer’s Disease. NPJ Digital Medicine. 2022;5(1):137.
  28. Discovering Dynamic Models of Covid-19 Transmission. Transboundary and Emerging Diseases. 2022;69(4):e64–e70.
  29. Combining Machine Learning and Computational Chemistry for Predictive Insights into Chemical Systems. Chemical Reviews. 2021;121(16):9816–9872.
  30. Ensemble-SINDy: Robust Sparse Model Discovery in the Low-Data, High-Noise Limit, With Active Learning and Control. Proceedings of the Royal Society A. 2022;478(2260):20210904.
  31. Sparsifying Priors for Bayesian Uncertainty Quantification in Model Discovery. Royal Society Open Science. 2022;9(2):211823.
  32. Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics. International Conference on Machine Learning. 2024;235:61321–61348.
  33. Daniel A Messenger, David M Bortz. Weak SINDy: Galerkin-Based Data-Driven Model Selection. Multiscale Modeling & Simulation. 2021;19(3):1474–1497.
  34. Daniel A Messenger, David M Bortz. Weak SINDy for Partial Differential Equations. Journal of Computational Physics. 2021;443:110525.
  35. Fourier Neural Operator for Parametric Partial Differential Equations. International Conference on Learning Representation. 2021;.
  36. Learning Dissipative Dynamics in Chaotic Systems. In: Advances in Neural Information Processing Systems; 2022. p. 16768–16781.
  37. Neural Laplace: Learning Diverse Classes of Differential Equations in the Laplace Domain. In: International Conference on Machine Learning. PMLR; 2022. p. 8811–8832.
  38. LNO: Laplace Neural Operator for Solving Differential Equations. arXiv preprint arXiv:230310528. 2023;.
  39. Colin L Mallows. Some Comments on Cp. Technometrics. 2000;42(1):87–94.
  40. A Unified Framework for Sparse Relaxed Regularized Regression: SR3. IEEE Access. 2018;7:1404–1423.
  41. Best Subset Selection via a Modern Optimization Lens. The Annals of Statistics. 2016;44(2):813–852.
  42. SA Billings, S Chen. The Determination of Multivariable Nonlinear Models for Dynamic Systems Using Neural Networks. Department of Automatic Control and Systems Engineering; 1996.
  43. John Charles Butcher. Numerical Methods for Ordinary Differential Equations. John Wiley & Sons; 2016.
  44. Gordon D Smith. Numerical Solution of Partial Differential Equations: Finite Difference Methods. Oxford university press; 1985.
  45. Randall J LeVeque. Finite Difference Methods for Ordinary and Partial Differential Equations: Steady-State and Time-Dependent Problems. SIAM; 2007.
  46. Spectral Methods for Time-Dependent Problems. Cambridge University Press. 2007;21.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com