Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Physics-Informed Solution of The Stationary Fokker-Plank Equation for a Class of Nonlinear Dynamical Systems: An Evaluation Study (2309.16725v1)

Published 25 Sep 2023 in physics.comp-ph, cs.LG, and physics.data-an

Abstract: The Fokker-Planck (FP) equation is a linear partial differential equation which governs the temporal and spatial evolution of the probability density function (PDF) associated with the response of stochastic dynamical systems. An exact analytical solution of the FP equation is only available for a limited subset of dynamical systems. Semi-analytical methods are available for larger, yet still a small subset of systems, while traditional computational methods; e.g. Finite Elements and Finite Difference require dividing the computational domain into a grid of discrete points, which incurs significant computational costs for high-dimensional systems. Physics-informed learning offers a potentially powerful alternative to traditional computational schemes. To evaluate its potential, we present a data-free, physics-informed neural network (PINN) framework to solve the FP equation for a class of nonlinear stochastic dynamical systems. In particular, through several examples concerning the stochastic response of the Duffing, Van der Pol, and the Duffing-Van der Pol oscillators, we assess the ability and accuracy of the PINN framework in $i)$ predicting the PDF under the combined effect of additive and multiplicative noise, $ii)$ capturing P-bifurcations of the PDF, and $iii)$ effectively treating high-dimensional systems. Through comparisons with Monte-Carlo simulations and the available literature, we show that PINN can effectively address all of the afore-described points. We also demonstrate that the computational time associated with the PINN solution can be substantially reduced by using transfer learning.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Lin, Y.-K. Probabilistic structural dynamics. \JournalTitleAdvanced theory and applications (1995).
  2. Stochastic averaging: an approximate method of solving random vibration problems. \JournalTitleInternational Journal of Non-Linear Mechanics 21, 111–134 (1986).
  3. Langley, R. A finite element method for the statistics of non-linear random vibration. \JournalTitleJournal of Sound and Vibration 101, 41–54 (1985).
  4. High fidelity numerical solutions of the fokker-planck equation. In Proc. of ICOSSAR, vol. 97, 24–28 (1997).
  5. A new method for the probabilistic solutions of large-scale nonlinear stochastic dynamic systems. In IUTAM Symposium on Nonlinear Stochastic Dynamics and Control: Proceedings of the IUTAM Symposium held in Hangzhou, China, May 10-14, 2010, 25–34 (Springer, 2011).
  6. Sparse grid discontinuous galerkin methods for high-dimensional elliptic equations. \JournalTitleJournal of Computational Physics 314, 244–263 (2016).
  7. Booton, R. C. Nonlinear control systems with random inputs. \JournalTitleIRE Transactions on Circuit Theory 1, 9–18 (1954).
  8. Random vibration with inelastic impact: equivalent nonlinearization technique. \JournalTitleJournal of Sound and Vibration 333, 189–199 (2014).
  9. Wu, W.-F. Comparison of gaussian closure technique and equivalent linearization method. \JournalTitleProbabilistic engineering mechanics 2, 2–8 (1987).
  10. Study of the Random Vibration of Nonlinear Systems by the Gaussian Closure Technique. \JournalTitleJournal of Applied Mechanics 45, 393–399, DOI: 10.1115/1.3424308 (1978).
  11. Crandall, S. H. Non-gaussian closure for random vibration of non-linear oscillators. \JournalTitleInternational Journal of Non-Linear Mechanics 15, 303–313 (1980).
  12. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. \JournalTitleJournal of Computational physics 378, 686–707 (2019).
  13. A deep learning method for solving fokker-planck equations. In Mathematical and scientific machine learning, 568–597 (PMLR, 2022).
  14. Solving inverse stochastic problems from discrete particle observations using the fokker–planck equation and physics-informed neural networks. \JournalTitleSIAM Journal on Scientific Computing 43, B811–B830 (2021).
  15. Monte carlo fpinns: Deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations. \JournalTitleComputer Methods in Applied Mechanics and Engineering 400, 115523 (2022).
  16. Xu, Y. et al. Solving fokker-planck equation using deep learning. \JournalTitlearXiv preprint arXiv:1910.10503 (2019).
  17. Stochastic bifurcations and coherencelike resonance in a self-sustained bistable noisy oscillator. \JournalTitlePhysical Review E 81, 011106 (2010).
  18. Van Kampen, N. G. Stochastic differential equations. \JournalTitlePhysics reports 24, 171–228 (1976).
  19. Random dynamical systems (Springer, 1995).
  20. Introduction to multi-layer feed-forward neural networks. \JournalTitleChemometrics and intelligent laboratory systems 39, 43–62 (1997).
  21. Evaluating derivatives: principles and techniques of algorithmic differentiation (SIAM, 2008).
  22. Activation functions: Comparison of trends in practice and research for deep learning. \JournalTitlearXiv preprint arXiv:1811.03378 (2018).
  23. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics, 249–256 (JMLR Workshop and Conference Proceedings, 2010).
  24. Adam: A method for stochastic optimization. \JournalTitlearXiv preprint arXiv:1412.6980 (2014).
  25. Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. \JournalTitleACM Transactions on mathematical software (TOMS) 23, 550–560 (1997).
  26. Inc., T. M. Matlab version: 9.13.0 (r2022b) (2022).
  27. Nonlinear dynamics of plasma oscillations modeled by a forced modified van der pol-duffing oscillator. \JournalTitlearXiv preprint arXiv:1308.6132 (2013).
  28. Miwadinou, C. et al. Modeling nonlinear dissipative chemical dynamics by a forced modified van der pol-duffing oscillator with asymmetric potential: chaotic behaviors predictions. \JournalTitleChinese Journal of Physics 56, 1089–1104 (2018).
  29. The fokker-planck equation, methods of solution and applications. \JournalTitleJournal of the Optical Society of America B Optical Physics 2, 508 (1985).
  30. Schmidt, G. Vibrations under simultaneous random forced and parametric excitation. \JournalTitleZeitschrift fuer angewandte Mathematik und Mechanik 60, 409–419 (1980).
  31. Investigations on the bifurcation of a noisy duffing–van der pol oscillator. \JournalTitleProbabilistic Engineering Mechanics 45, 70–86 (2016).
  32. Some instances of the fokker-planck equation numerical analysis for systems with gaussian noises. \JournalTitleEngineering Mechanics 15, 419–434 (2008).
  33. Impact of correlated noise in an energy depot model. \JournalTitleScientific Reports 6, 19591 (2016).
  34. To, C. W. Nonlinear random vibration: Analytical techniques and applications (Crc Press, 2000).
  35. Stochastic jump and bifurcation of a duffing oscillator under narrow-band excitation. \JournalTitleJournal of Sound and Vibration 165, 285–304 (1993).
  36. Finite element solution of fokker–planck equation of nonlinear oscillators subjected to colored non-gaussian noise. \JournalTitleProbabilistic Engineering Mechanics 38, 143–155 (2014).
  37. Numerical solution of the fokker–planck equation by finite difference and finite element methods—a comparative study. \JournalTitleComputational Methods in Stochastic Dynamics: Volume 2 69–85 (2013).
  38. Transfer learning. In Handbook of research on machine learning applications and trends: algorithms, methods, and techniques, 242–264 (IGI global, 2010).
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now