Universal energy-speed-accuracy trade-offs in driven nonequilibrium systems (2402.17931v2)
Abstract: Physical systems driven away from equilibrium by an external controller dissipate heat to the environment; the excess entropy production in the thermal reservoir can be interpreted as a "cost" to transform the system in a finite time. The connection between measure theoretic optimal transport and dissipative nonequilibrium dynamics provides a language for quantifying this cost and has resulted in a collection of "thermodynamic speed limits", which argue that the minimum dissipation of a transformation between two probability distributions is directly proportional to the rate of driving. Thermodynamic speed limits rely on the assumption that the target probability distribution is perfectly realized, which is almost never the case in experiments or numerical simulations. Here, we address the ubiquitous situation in which the external controller is imperfect. As a consequence, we obtain a lower bound for the dissipated work in generic nonequilibrium control problems that 1) is asymptotically tight and 2) matches the thermodynamic speed limit in the case of optimal driving. We illustrate these bounds on analytically solvable examples and also develop a strategy for optimizing minimally dissipative protocols based on optimal transport flow matching, a generative machine learning technique. This latter approach ensures the scalability of both the theoretical and computational framework we put forth. Crucially, we demonstrate that we can compute the terms in our bound numerically using efficient algorithms from the computational optimal transport literature and that the protocols that we learn saturate the bound.
- Building normalizing flows with stochastic interpolants. In The eleventh international conference on learning representations, ICLR 2023, kigali, rwanda, may 1-5, 2023. OpenReview.net, 2023. tex.bibsource: dblp computer science bibliography, https://dblp.org tex.timestamp: Fri, 30 Jun 2023 14:55:53 +0200.
- Refined Second Law of Thermodynamics for Fast Random Processes. Journal of Statistical Physics, 147(3):487–505, May 2012.
- Optimal Protocols and Optimal Transport in Stochastic Thermodynamics. Physical Review Letters, 106(25):250601, June 2011.
- Thermodynamic Uncertainty Relation for Biomolecular Processes. Phys. Rev. Lett., 114(15):158101, April 2015.
- Quantum Statistical Learning via Quantum Wasserstein Natural Gradient. Journal of Statistical Physics, 182(1):7, January 2021.
- Realization of a micrometre-sized stochastic heat engine. Nature Physics, 8(2):143–146, February 2012. Number: 2 Publisher: Nature Publishing Group.
- Deep learning probability flows and entropy production rates in active matter, September 2023.
- Neural ordinary differential equations. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in neural information processing systems, volume 31. Curran Associates, Inc., 2018.
- Matrix Optimal Mass Transport: A Quantum Mechanical Approach. IEEE Transactions on Automatic Control, 63(8):2612–2619, August 2018. Conference Name: IEEE Transactions on Automatic Control.
- Optimal Transport for Gaussian Mixture Models. IEEE Access, 7:6269–6278, 2019.
- Unified, Geometric Framework for Nonequilibrium Protocol Optimization. Physical Review Letters, 130(10):107101, March 2023. Publisher: American Physical Society.
- Ensuring thermodynamic consistency with invertible coarse-graining. The Journal of Chemical Physics, 158(12):124126, March 2023. Publisher: American Institute of Physics.
- Gavin E. Crooks. Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Physical Review E, 60(3):2721–2726, September 1999.
- Gavin E Crooks. Measuring Thermodynamic Length. Phys. Rev. Lett., 99(10):100602, September 2007.
- Marco Cuturi. Sinkhorn distances: Lightspeed computation of optimal transport. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, editors, Advances in neural information processing systems 26, pages 2292–2300. Curran Associates, Inc., 2013.
- Geometric decomposition of entropy production in out-of-equilibrium systems. Physical Review Research, 4(1):L012034, March 2022. tex.ids= dechant_geometric_2021 arXiv: 2109.12817.
- Optimal Control of Nonequilibrium Systems through Automatic Differentiation. Physical Review X, 13(4):041032, November 2023. Publisher: American Physical Society.
- Dissipation Bounds All Steady-State Current Fluctuations. Phys. Rev. Lett., 116(12):120601, March 2016.
- Inferring dissipation from current fluctuations. J. Phys. A: Math. Theor., 50(18):184004, April 2017.
- C. Jarzynski. Targeted free energy perturbation. Physical Review E, 65(4):046122, April 2002. arXiv: cond-mat/0109461.
- The Variational Formulation of the Fokker–Planck Equation. SIAM Journal on Mathematical Analysis, 29(1):1–17, January 1998.
- Physics-informed machine learning. Nature Reviews Physics, 3(6):422–440, June 2021.
- Jorge Kurchan. Fluctuation theorem for stochastic dynamics. J. Phys. A, 31(16):3719–3729, 1998.
- A Gallavotti–Cohen-Type Symmetry in the Large Deviation Functional for Stochastic Dynamics. Journal of Statistical Physics, 95(1):333–365, April 1999.
- Flow Matching for Generative Modeling. September 2022.
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow. September 2022.
- Jan Maas. Gradient flows of the entropy for finite Markov chains. Journal of Functional Analysis, 261(8):2250–2292, October 2011.
- Statistical bounds for entropic optimal transport: sample complexity and the central limit theorem. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019.
- Geometrical aspects of entropy production in stochastic thermodynamics based on Wasserstein distance. Physical Review Research, 3(4):043093, November 2021. Publisher: American Physical Society.
- Radford M Neal. Annealed importance sampling. Statistics and Computing, 11:125–139, 2001.
- Computational optimal transport: With applications to data science. Foundations and Trends in Machine Learning, 11(5-6):355–607, 2019.
- Multisample Flow Matching: Straightening Flows with Minibatch Couplings. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine Learning Research, pages 28100–28127. PMLR, 2023.
- Geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems. Physical Review E, 95(1):012148, January 2017.
- Stochastic thermodynamics of chemical reaction networks. J. Chem. Phys., 126(4):044101, 2007.
- U. Seifert. Stochastic thermodynamics: Principles and perspectives. European Physical Journal B, 64(3-4):423–431, 2008.
- Thermodynamic metrics and optimal paths. Phys. Rev. Lett., 108(19):190602, May 2012.
- Generalized thermodynamics of phase equilibria in scalar active matter. Physical Review E, 97(2):020602, February 2018. Publisher: American Physical Society.
- Daniel W. Stroock. Logarithmic Sobolev inequalities for gibbs states. In Eugene Fabes, Masatoshi Fukushima, Leonard Gross, Carlos Kenig, Michael Röckner, Daniel W. Stroock, Gianfausto Dell’Antonio, and Umberto Mosco, editors, Dirichlet Forms: Lectures given at the 1st Session of the Centro Internazionale Matematico Estivo (C.I.M.E.) held in Varenna, Italy, June 8–19, 1992, Lecture Notes in Mathematics, pages 194–228. Springer, Berlin, Heidelberg, 1993.
- Improving and generalizing flow-based generative models with minibatch optimal transport, October 2023. arXiv:2302.00482 [cs].
- Escorted free energy simulations. J. Chem. Phys., page 12, 2011.
- Thermodynamic unification of optimal transport: Thermodynamic uncertainty relation, minimum dissipation, and thermodynamic speed limits. Phys. Rev. X, 13:011013, Feb 2023.
- Housekeeping and excess entropy production for general nonlinear dynamics. Physical Review Research, 5(1):013017, January 2023.