Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
121 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

EPR-Net: Constructing non-equilibrium potential landscape via a variational force projection formulation (2301.01946v3)

Published 5 Jan 2023 in physics.bio-ph, cond-mat.stat-mech, cs.AI, and physics.comp-ph

Abstract: We present EPR-Net, a novel and effective deep learning approach that tackles a crucial challenge in biophysics: constructing potential landscapes for high-dimensional non-equilibrium steady-state (NESS) systems. EPR-Net leverages a nice mathematical fact that the desired negative potential gradient is simply the orthogonal projection of the driving force of the underlying dynamics in a weighted inner-product space. Remarkably, our loss function has an intimate connection with the steady entropy production rate (EPR), enabling simultaneous landscape construction and EPR estimation. We introduce an enhanced learning strategy for systems with small noise, and extend our framework to include dimensionality reduction and state-dependent diffusion coefficient case in a unified fashion. Comparative evaluations on benchmark problems demonstrate the superior accuracy, effectiveness, and robustness of EPR-Net compared to existing methods. We apply our approach to challenging biophysical problems, such as an 8D limit cycle and a 52D multi-stability problem, which provide accurate solutions and interesting insights on constructed landscapes. With its versatility and power, EPR-Net offers a promising solution for diverse landscape construction problems in biophysics.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Waddington C. The strategy of the genes 1957.
  2. Ao P. Potential in stochastic differential equations: novel construction. J. Phys. A-Math. Gen. 2004; 37: L25.
  3. Wang J, Xu L and Wang E. Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations. Proc. Nat. Acad. Sci. USA 2008; 105: 12271.
  4. Wang J, Li C and Wang E. Potential and flux landscapes quantify the stability and robustness of budding yeast cell cycle network. Proc. Nat. Acad. Sci. USA 2010; 107: 8195.
  5. Quantifying the Waddington landscape and biological paths for development and differentiation. Proc. Nat. Acad. Sci. USA 2011; 108: 8257.
  6. Quasi-potential landscape in complex multi-stable systems. J. R. Soc., Interface 2012; 9: 3539.
  7. Landscapes of non-gradient dynamics without detailed balance: Stable limit cycles and multiple attractors. Chaos 2012; 22: 023140.
  8. Constructing the energy landscape for genetic switching system driven by intrinsic noise. PLoS ONE 2014; 9: e88167.
  9. Energy landscape decomposition for cell differentiation with proliferation effect. Nat. Sci. Rev. 2022; 9: nwac116.
  10. Escape problem for irreversible systems. Phys. Rev. E 1993; 48: 931.
  11. Epigenetics as a first exit problem. Phys. Rev. Lett. 2002; 88: 048101.
  12. Stochastic gene expression as a many-body problem. Proc. Nat. Acad. Sci. USA 2003; 100: 2374.
  13. Optimal path to epigenetic switching. Phys. Rev. E 2005; 71: 011902.
  14. Ferrell JEJ. Bistability, bifurcations, and Waddington’s epigenetic landscape. Curr. Biol. 2012; 22: R458.
  15. Wang J. Landscape and flux theory of non-equilibrium dynamical systems with application to biology. Adv. Phys. 2015; 64: 1.
  16. Construction of the landscape for multi-stable systems: Potential landscape, quasi-potential, A-type integral and beyond. J. Chem. Phys. 2016; 144: 094109.
  17. Cancer as robust intrinsic state shaped by evolution: a key issues review. Rep. Prog. Phys. 2017; 80: 042701.
  18. Nonequilibrium physics in biology. Rev. Mod. Phys. 2019; 91: 045004.
  19. Li C, Hong T and Nie Q. Quantifying the landscape and kinetic paths for epithelial–mesenchymal transition from a core circuit. Phys. Chem. Chem. Phys. 2016; 18: 17949–56.
  20. Cameron M. Finding the quasipotential for nongradient SDEs. Phys. D 2012; 241: 1532.
  21. Landscape and flux reveal a new global view and physical quantification of mammalian cell cycle. Proc. Nat. Acad. Sci. USA 2014; 111: 14130.
  22. Lin B, Li Q and Ren W. Computing the invariant distribution of randomly perturbed dynamical systems using deep learning. J. Sci. Comp. 2022; 91: 77.
  23. Lin B, Li Q and Ren W. Computing high-dimensional invariant distributions from noisy data. J. Comp. Phys. 2023; 474: 111783.
  24. Lin B, Li Q and Ren W. A data driven method for computing quasipotentials. Proc. Mach. Learn. Res., volume 145 of 2nd Annual Conference on Mathematical and Scientific Machine Learning (2021) 652.
  25. Viscosity solution of Hamilton-Jacobi equations. Trans. Amer. Math. Soc. 1983; 277: 1.
  26. Raissi M, Perdikaris P and Karniadakis GE. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comp. Phys. 2019; 378: 686.
  27. Quantifying cell fate decisions for differentiation and reprogramming of a human stem cell network: Landscape and biological paths. PLoS Comput. Biol. 2013; 9: e1003165.
  28. Goodfellow I, Bengio Y and Courville A. Deep learning 2016.
  29. DeePCG: Constructing coarse-grained models via deep neural networks. J. Chem. Phys. 2018; 149: 034101.
  30. Coarse graining molecular dynamics with graph neural networks. J. Chem. Phys. 2020; 153: 194101.
  31. Hyvärinen A. Estimation of non-normalized statistical models by score matching. J. Mach. Learn. Res. 2005; 6: 695–709.
  32. Generative modeling by estimating gradients of the data distribution. Wallach H, Larochelle H, Beygelzimer A et al., editors, Advances in Neural Information Processing Systems, volume 32 of NeurIPS (2019) 11918–30.
  33. Methods of mathematical physics 1953.
  34. Khasminskii R. Stochastic stability of differential equations 2012.
  35. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems, volume 32 of NeurIPS (2019) 8024.
  36. Qian H. Mesoscopic nonequilibrium thermodynamics of single macromolecules and dynamic entropy-energy compensation. Phys. Rev. E 2001; 65: 016102.
  37. Zhang X, Qian H and Qian M. Stochastic theory of nonequilibrium steady states and its applications. part i. Phys. Rep. 2012; 510: 1–86.
  38. Mei S, Montanari A and Nguyen PM. A mean field view of the landscape of two-layer neural networks. Proc. Nat. Acad. Sci. USA 2018; 115: E7665–E71.
  39. Kobyzev I, Prince SJD and Brubaker M. Normalizing flows: An introduction and review of current methods. IEEE Trans. Patt. Anal. Mach. Intel. 2021; 43: 3964–79.
  40. Zhu XM, Yin L and Ao P. Limit cycle and conserved dynamics. International Journal of Modern Physics B 2006; 20: 817–27.
  41. Potential function in a continuous dissipative chaotic system: Decomposition scheme and role of strange attractor. International Journal of Bifurcation and Chaos 2014; 24: 1450015.
  42. Lorenz EN. Deterministic nonperiodic flow. J. Atmos. Sci. 1963; 20: 130–41.
  43. Zhang W, Hartmann C and Schütte C. Effective dynamics along given reaction coordinates, and reaction rate theory. Faraday Discuss. 2016; 195: 365–94.
  44. A dimension reduction approach for energy landscape: Identifying intermediate states in metabolism-emt network. Adv. Sci. 2021; 8: 2003133.
  45. Ferrell JE, Tsai TYC and Yang Q. Modeling the cell cycle: Why do certain circuits oscillate? Cell 2011; 144: 874–85.
  46. Hirsch MW, Smale S and Devaney RL. Differential equations, dynamical systems, and an introduction to chaos 2004.
  47. Bonati L, Zhang YY and Parrinello M. Neural networks-based variationally enhanced sampling. Proc. Nat. Acad. Sci., USA 2019; 116: 17641–7.
  48. Bonati L, Rizzi V and Parrinello M. Data-driven collective variables for enhanced sampling. J. Phys. Chem. Lett. 2020; 11: 2998–3004.
  49. Evans LC. Partial differential equations 2010.
  50. Holmes MH. Introduction to perturbation methods 2013.
  51. Understanding molecular simulation: From algorithms to applications 2002.
  52. Adam: a method for stochastic optimization. Proceedings of the International Conference on Learning Representations (2015) .
  53. Neural spline flows. Advances in Neural Information Processing Systems, volume 32 of NeurIPS (2019) .
Citations (5)

Summary

We haven't generated a summary for this paper yet.