2000 character limit reached
Learning Regions of Attraction in Unknown Dynamical Systems via Zubov-Koopman Lifting: Regularities and Convergence
Published 25 Nov 2023 in math.DS and math.AP | (2311.15119v2)
Abstract: The estimation for the region of attraction (ROA) of an asymptotically stable equilibrium point is crucial in the analysis of nonlinear systems. There has been a recent surge of interest in estimating the solution to Zubov's equation, whose non-trivial sub-level sets form the exact ROA. In this paper, we propose a lifting approach to map observable data into an infinite-dimensional function space, which generates a flow governed by the proposed `Zubov-Koopman' operators. By learning a Zubov-Koopman operator over a fixed time interval, we can indirectly approximate the solution to Zubov's equation through iterative application of the learned operator on certain functions. We also demonstrate that a transformation of such an approximator can be readily utilized as a near-maximal Lyapunov function. We approach our goal through a comprehensive investigation of the regularities of Zubov-Koopman operators and their associated quantities. Based on these findings, we present an algorithm for learning Zubov-Koopman operators that exhibit strong convergence to the true operator. We show that this approach reduces the amount of required data and can yield desirable estimation results, as demonstrated through numerical examples.
- Y. Li and J. Liu, “Robustly complete synthesis of memoryless controllers for nonlinear systems with reach-and-stay specifications,” IEEE Transactions on Automatic Control, vol. 66, no. 3, pp. 1199–1206, 2020.
- F. Wilson, “Smoothing derivatives of functions and applications,” Transactions of the American Mathematical Society, vol. 139, pp. 413–428, 1969.
- Y. Lin, E. D. Sontag, and Y. Wang, “A smooth converse lyapunov theorem for robust stability,” SIAM Journal on Control and Optimization, vol. 34, no. 1, pp. 124–160, 1996.
- F. H. Clarke, Y. S. Ledyaev, and R. J. Stern, “Asymptotic stability and smooth lyapunov functions,” Journal of differential Equations, vol. 149, no. 1, pp. 69–114, 1998.
- A. R. Teel and L. Praly, “A smooth lyapunov function from a class-estimate involving two positive semidefinite functions,” ESAIM: Control, Optimisation and Calculus of Variations, vol. 5, pp. 313–367, 2000.
- A. Vannelli and M. Vidyasagar, “Maximal lyapunov functions and domains of attraction for autonomous nonlinear systems,” Automatica, vol. 21, no. 1, pp. 69–80, 1985.
- K. K. Hassan et al., “Nonlinear systems,” Departement of Electrical and computer Engineering, Michigan State University, 2002.
- P. Giesl and S. Hafstein, “Review on computational methods for Lyapunov functions,” Discrete & Continuous Dynamical Systems-B, vol. 20, no. 8, p. 2291, 2015.
- C. Dawson, S. Gao, and C. Fan, “Safe control with learned certificates: A survey of neural Lyapunov, barrier, and contraction methods for robotics and control,” IEEE Transactions on Robotics, pp. 1–19, 2023.
- S. L. Brunton, M. Budišić, E. Kaiser, and J. N. Kutz, “Modern koopman theory for dynamical systems,” arXiv preprint arXiv:2102.12086, 2021.
- B. O. Koopman, “Hamiltonian systems and transformation in hilbert space,” Proceedings of the National Academy of Sciences, vol. 17, no. 5, pp. 315–318, 1931.
- I. Mezić, “Spectral properties of dynamical systems, model reduction and decompositions,” Nonlinear Dynamics, vol. 41, pp. 309–325, 2005.
- P. J. Schmid and J. Sesterhenn, “Dynamic mode decomposition of experimental data,” in 8th International Symposium on Particle Image Velocimetry, Melbourne, Victoria, Australia, 2009.
- M. O. Williams, I. G. Kevrekidis, and C. W. Rowley, “A data–driven approximation of the koopman operator: Extending dynamic mode decomposition,” Journal of Nonlinear Science, vol. 25, pp. 1307–1346, 2015.
- B. Lusch, J. N. Kutz, and S. L. Brunton, “Deep learning for universal linear embeddings of nonlinear dynamics,” Nature communications, vol. 9, no. 1, p. 4950, 2018.
- O. Azencot, N. B. Erichson, V. Lin, and M. Mahoney, “Forecasting sequential data using consistent koopman autoencoders,” in International Conference on Machine Learning, pp. 475–485, PMLR, 2020.
- A. Mauroy and I. Mezić, “A spectral operator-theoretic framework for global stability,” in 52nd IEEE Conference on Decision and Control, pp. 5234–5239, IEEE, 2013.
- A. Mauroy and I. Mezić, “Global stability analysis using the eigenfunctions of the koopman operator,” IEEE Transactions on Automatic Control, vol. 61, no. 11, pp. 3356–3369, 2016.
- S. A. Deka, A. M. Valle, and C. J. Tomlin, “Koopman-based neural lyapunov functions for general attractors,” in 2022 IEEE 61st Conference on Decision and Control (CDC), pp. 5123–5128, IEEE, 2022.
- R. Zhou, T. Quartz, H. De Sterck, and J. Liu, “Neural lyapunov control of unknown nonlinear systems with stability guarantees,” Advances in Neural Information Processing Systems, vol. 35, pp. 29113–29125, 2022.
- J. Liu, Y. Meng, M. Fitzsimmons, and R. Zhou, “Towards learning and verifying maximal neural lyapunov functions,” arXiv preprint arXiv:2304.07215, 2023.
- L. Grüne, “Computing lyapunov functions using deep neural networks,” Journal of Computational Dynamics, vol. 8, no. 2, pp. 131–152, 2021.
- M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational physics, vol. 378, pp. 686–707, 2019.
- W. Kang, K. Sun, and L. Xu, “Data-driven computational methods for the domain of attraction and zubov’s equation,” arXiv preprint arXiv:2112.14415, 2021.
- Y. Lan and I. Mezić, “Linearization in the large of nonlinear systems and koopman operator spectrum,” Physica D: Nonlinear Phenomena, vol. 242, no. 1, pp. 42–53, 2013.
- M. D. Kvalheim and S. Revzen, “Existence and uniqueness of global koopman eigenfunctions for stable fixed points and periodic orbits,” Physica D: Nonlinear Phenomena, vol. 425, p. 132959, 2021.
- US Atomic Energy Commission, 1961.
- Springer, 1997.
- Q. J. Zhu, “Lower semicontinuous lyapunov functions and stability,” Journal of Nonlinear and Convex Analysis, vol. 4, p. 325, 2003.
- M. Jones and M. M. Peet, “Converse lyapunov functions and converging inner approximations to maximal regions of attraction of nonlinear systems,” in 2021 60th IEEE Conference on Decision and Control (CDC), pp. 5312–5319, IEEE, 2021.
- American Mathematical Society, 2010.
- F. Camilli, L. Grüne, and F. Wirth, “A generalization of zubov’s method to perturbed systems,” SIAM Journal on Control and Optimization, vol. 40, no. 2, pp. 496–515, 2001.
- Y. Meng, Y. Li, and J. Liu, “Control of nonlinear systems with reach-avoid-stay specifications: A lyapunov-barrier approach with an application to the moore-greizer model,” in 2021 American Control Conference (ACC), pp. 2284–2291, 2021.
- Y. Meng, Y. Li, M. Fitzsimmons, and J. Liu, “Smooth converse lyapunov-barrier theorems for asymptotic stability with safety constraints and reach-avoid-stay specifications,” Automatica, vol. 144, p. 110478, 2022.
- Y. Meng and J. Liu, “Lyapunov-barrier characterization of robust reach–avoid–stay specifications for hybrid systems,” Nonlinear Analysis: Hybrid Systems, vol. 49, p. 101340, 2023.
- B. Oksendal, Stochastic differential equations: an introduction with applications. Springer Science & Business Media, 2013.
- A. Mauroy and J. Goncalves, “Koopman-based lifting techniques for nonlinear systems identification,” IEEE Transactions on Automatic Control, vol. 65, no. 6, pp. 2550–2565, 2019.
- G. Khromov and S. P. Singh, “Some fundamental aspects about lipschitz continuity of neural network functions,” arXiv preprint arXiv:2302.10886, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper.