Papers
Topics
Authors
Recent
2000 character limit reached

Colored-LIM: A Data-Driven Method for Studying Dynamical Systems with Temporally Correlated Stochasticity (2402.15184v2)

Published 23 Feb 2024 in math.NA and cs.NA

Abstract: In real-world problems, environmental noise is often idealized as Gaussian white noise, despite potential temporal dependencies. The Linear Inverse Model (LIM) is a class of data-driven methods that extract dynamic and stochastic information from finite time-series data of complex systems. In this study, we introduce a new variant of LIM, called Colored-LIM, which models stochasticity using Ornstein-Uhlenbeck colored noise. Despite the non-trivial correlation between observable and colored noise, we show that Colored-LIM unveils the desired information merely from the correlation function of the observable. Therefore, this approach not only accounts for the memory effects of environmental noise, traditionally represented by time-uncorrelated white noise in the Classical LIM framework, but does so using the same observation dataset without requiring additional data. Furthermore, we show that Colored-LIM does not reduce to Classical LIM in the white noise limit, underscoring the importance of temporal dependencies in stochastic systems. In this paper, we rigorously develop the Colored-LIM, explore its connections with the Classical LIM and Dynamic Mode Decomposition, and validate its effectiveness on both ideal linear and nonlinear systems. In addition, we illustrate the potential applications and implications of Colored-LIM for real-world problems, including the El Ni~no-Southern Oscillation and the electricity network of Tohoku University.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. A review of multiple regression by least squares, pages 1–16. Springer Netherlands, Dordrecht, 1986.
  2. Non-markovianity of colored noisy channels. Phys. Rev. A, 89:012114, Jan 2014.
  3. S. Chapra. Applied Numerical Methods with MATLAB for Engineers and Scientists. McGraw-Hill Education, 2018.
  4. R. Chartrand. Numerical differentiation of noisy, nonsmooth data. ISRN Applied Mathematics, 2011:164564, May 2011.
  5. B. Cui and A. Zaccone. Generalized langevin equation and fluctuation-dissipation theorem for particle-bath systems in external oscillating fields. Phys. Rev. E, 97:060102, Jun 2018.
  6. W.-L. Duan and H. Fang. The unified colored noise approximation of multidimensional stochastic dynamic system. Physica A: Statistical Mechanics and its Applications, 555:124624, 2020.
  7. G. Falsone. Stochastic differential calculus for gaussian and non-gaussian noises: A critical review. Communications in Nonlinear Science and Numerical Simulation, 56:198–216, 2018.
  8. Experimental metrics for detection of detailed balance violation. Phys. Rev. E, 99:022143, Feb 2019.
  9. Irreversibility in linear systems with colored noise. Phys. Rev. E, 105(2):024118–10, 2022.
  10. Reconstructing complex system dynamics from time series: a method comparison. New Journal of Physics, 22(7):073053, jul 2020.
  11. P. Jung and P. Hänggi. Dynamical systems: A unified colored-noise approximation. Phys. Rev. A, 35:4464–4466, May 1987.
  12. P. Jung and H. Risken. Motion in a double-well potential with additive colored gaussian noise. Zeitschrift für Physik B Condensed Matter, 61(3):367–379, Sep 1985.
  13. Data-driven non-markovian closure models. Physica D: Nonlinear Phenomena, 297:33–55, 2015.
  14. Multilevel regression modeling of nonlinear processes: Derivation and applications to climatic variability. Journal of Climate, 18(21):4404–4424, 2005.
  15. F. Kwasniok. Linear inverse modeling of large-scale atmospheric flow using optimal mode decomposition. Journal of the Atmospheric Sciences, 79(9):2181–2204, 2022.
  16. Colored noise in dynamical systems. SIAM Journal on Applied Mathematics, 48(2):425–441, 1988.
  17. Calculating state-dependent noise in a linear inverse model framework. Journal of the Atmospheric Sciences, 75:479–496, 2017.
  18. P. McCullagh. Generalized Linear Models. CRC Press, 2019.
  19. G. N. Mil’shtein. A method of second-order accuracy integration of stochastic differential equations. Theory of Probability & Its Applications, 23(2):396–401, 1979.
  20. Usage of the Mori-Zwanzig method in time series analysis. Phys Rev E Stat Nonlin Soft Matter Phys, 77(1 Pt 1):011117, Jan 2008.
  21. B. Øksendal. Stochastic differential equations : an introduction with applications. Journal of the American Statistical Association, 82:948, 1987.
  22. C. Penland. Random forcing and forecasting using principal oscillation pattern analysis. Monthly Weather Review, 117(10):2165–2185, 1989.
  23. C. Penland and T. Magorian. Prediction of niño 3 sea surface temperatures using linear inverse modeling. Journal of Climate, 6(6):1067–1076, 1993.
  24. C. Penland and L. Matrosova. A balance condition for stochastic numerical models with application to the el niño-southern oscillation. Journal of Climate, 7(9):1352–1372, 1994.
  25. H. Risken. The Fokker-Planck equation, volume 18 of Springer Series in Synergetics. Springer-Verlag, Berlin, second edition, 1989. Methods of solution and applications.
  26. D. T. Schmitt and M. Schulz. Analyzing memory effects of complex systems from time series. Phys. Rev. E, 73:056204, May 2006.
  27. U. Seifert. Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics, 75(12):126001, nov 2012.
  28. Impact of annual cycle on enso variability and predictability. Journal of Climate, 34(1):171–193, 2021.
  29. J. J. Stickel. Data smoothing and numerical differentiation by a regularization method. Computers & Chemical Engineering, 34(4):467–475, 2010.
  30. S. Särkkä and A. Solin. Applied Stochastic Differential Equations. Institute of Mathematical Statistics Textbooks. Cambridge University Press, 2019.
  31. Stochastic system with coupling between non-gaussian and gaussian noise terms. Physica A: Statistical Mechanics and its Applications, 373:203–214, 2007.
  32. The study on a stochastic system with non-gaussian noise and gaussian colored noise. Physica A: Statistical Mechanics and its Applications, 388(6):781–788, 2009.
  33. H. Zhivomirov. A method for colored noise generation. Romanian journal of acoustics and vibration, 15(1):14–19, 2018.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.