Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy data (2402.15357v2)
Abstract: We propose a fast probabilistic framework for identifying differential equations governing the dynamics of observed data. We recast the SINDy method within a Bayesian framework and use Gaussian approximations for the prior and likelihood to speed up computation. The resulting method, Bayesian-SINDy, not only quantifies uncertainty in the parameters estimated but also is more robust when learning the correct model from limited and noisy data. Using both synthetic and real-life examples such as Lynx-Hare population dynamics, we demonstrate the effectiveness of the new framework in learning correct model equations and compare its computational and data efficiency with existing methods. Because Bayesian-SINDy can quickly assimilate data and is robust against noise, it is particularly suitable for biological data and real-time system identification in control. Its probabilistic framework also enables the calculation of information entropy, laying the foundation for an active learning strategy.
- Horrocks J, Bauch CT. 2020 Algorithmic Discovery of Dynamic Models from Infectious Disease Data. Sci. Rep. 10. (10.1038/s41598-020-63877-w)
- Tibshirani R. 1996 Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B: Statistical Methodology 58, 267–288.
- MacKay DJC. 1992 Bayesian Interpolation. Neural Computation 4, 415–447. (10.1162/neco.1992.4.3.415)
- Titterington DM. 1985 Common Structure of Smoothing Techniques in Statistics. Int. Stat. Rev. Rev. Int. Stat. 53, 141–170. (10.2307/1402932)
- Faul AC. 2020 A Concise Introduction to Machine Learning. Boca Raton: CRC.
- Hewitt CG. 1921 The Conservation of the Wild Life of Canada. C. Scribner’s Sons.
- Mahaffy J. 2010 Math 636 Lecture Notes on Mathematical Modelling - Lotka-Volterra Models. https://jmahaffy.sdsu.edu/courses/f09/math636/lectures/lotka/qualde2.html.
- Carpenter B. 2018 Predator-Prey Population Dynamics: The Lotka-Volterra Model in Stan. https://mc-stan.org/users/documentation/case-studies/lotka-volterra-predator-prey.html.
- Lindley DV. 1956 On a Measure of the Information Provided by an Experiment. Ann. Math. Stat. 27, 986–1005. (10.1214/aoms/1177728069)