Koopman operators with intrinsic observables in rigged reproducing kernel Hilbert spaces (2403.02524v2)
Abstract: This paper presents a novel approach for estimating the Koopman operator defined on a reproducing kernel Hilbert space (RKHS) and its spectra. We propose an estimation method, what we call Jet Dynamic Mode Decomposition (JetDMD), leveraging the intrinsic structure of RKHS and the geometric notion known as jets to enhance the estimation of the Koopman operator. This method refines the traditional Extended Dynamic Mode Decomposition (EDMD) in accuracy, especially in the numerical estimation of eigenvalues. This paper proves JetDMD's superiority through explicit error bounds and convergence rate for special positive definite kernels, offering a solid theoretical foundation for its performance. We also delve into the spectral analysis of the Koopman operator, proposing the notion of extended Koopman operator within a framework of rigged Hilbert space. This notion leads to a deeper understanding of estimated Koopman eigenfunctions and capturing them outside the original function space. Through the theory of rigged Hilbert space, our study provides a principled methodology to analyze the estimated spectrum and eigenfunctions of Koopman operators, and enables eigendecomposition within a rigged RKHS. We also propose a new effective method for reconstructing the dynamical system from temporally-sampled trajectory data of the dynamical system with solid theoretical guarantee. We conduct several numerical simulations using the van der Pol oscillator, the Duffing oscillator, the H\'enon map, and the Lorenz attractor, and illustrate the performance of JetDMD with clear numerical computations of eigenvalues and accurate predictions of the dynamical systems.
- Active learning of dynamics for data-driven control using Koopman operators. IEEE Transactions on Robotics, 35(5):1071–1083, 2019.
- An incremental approach to online dynamic mode decomposition for time-varying systems with applications to eeg data modeling. Journal of Computational Dynamics, 7(2):209–241, 2020.
- N. Aronszajn. Theory of reproducing kernels. Transactions of the American Mathematical Society, 68(3):337–404, 1950.
- Estimation of perturbations in robotic behavior using dynamic mode decomposition. Advanced Robotics, 29(5):331–343, 2015.
- Koopman kernel regression. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
- Dirac Kets, Gamow Vectors, and Gel’fand Triplets: The Rigged Hilbert Space Formulation of Quantum Mechanics : Lectures in Mathematical Physics at the University of Texas at Austin. Lecture notes in physics. Springer-Verlag, 1989.
- Armand Borel. Linear algebraic groups, volume 126 of Graduate Texts in Mathematics. Springer-Verlag, New York, second edition, 1991.
- Koopman-based control of a soft continuum manipulator under variable loading conditions. IEEE Robotics and Automation Letters, 6(4):6852–6859, 2021.
- Modeling and control of soft robots using the Koopman operator and model predictive control. In Proceedings of Robotics: Science and Systems, FreiburgimBreisgau, Germany, June 2019.
- Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition. Journal of Neuroscience Methods, 258:1–15, 2016.
- Modern Koopman theory for dynamical systems. SIAM Review, 64(2):229–340, 2022.
- Composition operators on the Fock space. Acta Scientiarum Mathematicarum, 69(3-4):871–887, 2003.
- Hayato Chiba. A spectral theory of linear operators on rigged Hilbert spaces under analyticity conditions. Advances in Mathematics, 273:324–379, 2015.
- Generalized eigenvalues of the Perron–Frobenius operators of symbolic dynamical systems. SIAM Journal on Applied Dynamical Systems, 22(4):2825–2855, 2023.
- Residual dynamic mode decomposition: robust and verified Koopmanism. Journal of Fluid Mechanics, 955:A21, 2023.
- Rigorous data-driven computation of spectral properties of Koopman operators for dynamical systems. Communications on Pure and Applied Mathematics, 77(1):221–283, 2024.
- Composition Operators on Spaces of Analytic Functions. CRC Press, Boca Raton, 1995.
- Koopman spectra in reproducing kernel Hilbert spaces. Applied and Computational Harmonic Analysis, 49(2):573–607, 2020.
- Methods of numerical integration. Dover Publications, Inc., Mineola, NY, 2007. Corrected reprint of the second (1984) edition.
- Bengt Fornberg. Generation of finite difference formulas on arbitrarily spaced grids. Mathematics of Computation, 51(184):699–706, 1988.
- Dynamic mode decomposition in vector-valued reproducing kernel Hilbert spaces for extracting dynamical structure among observables. Neural Networks, 117:94–103, 2019.
- Generalized Functions, Volume 2: Spaces of Fundamental and Generalized Functions. AMS Chelsea Publishing. American Mathematical Society, 2016.
- Generalized Functions: Applications of Harmonic Analysis. Generalized functions. Elsevier Science, 2014.
- Koopman spectral analysis of skew-product dynamics on Hilbert C*superscript𝐶C^{*}italic_C start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT-modules. arXiv: 2307.08965, 2023.
- Koopman analysis of the long-term evolution in a turbulent convection cell. Journal of Fluid Mechanics, 847:735–767, 2018.
- T. N. E. Greville. Note on the generalized inverse of a matrix product. SIAM Review, 8(4):518–521, 1966.
- Reproducing kernel Hilbert C*superscript𝐶C^{*}italic_C start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT-module and kernel mean embeddings. Journal of Machine Learning Research, 22(267):1–56, 2021.
- Krylov subspace method for nonlinear dynamical systems with random noise. Journal of Machine Learning Research, 21(172):1–29, 2020.
- Koopman-based generalization bound: New aspect for full-rank weights. In The Twelfth International Conference on Learning Representations, 2024.
- Nicholas J. Higham. Functions of Matrices. Society for Industrial and Applied Mathematics, 2008.
- Kernel methods in machine learning. The Annals of Statistics, 36(3):1171 – 1220, 2008.
- Matrix analysis. Cambridge University Press, Cambridge, second edition, 2013.
- Boundedness of composition operators on reproducing kernel Hilbert spaces with analytic positive definite functions. Journal of Mathematical Analysis and Applications, 511(1):126048, 2022.
- Koopman and Perron–Frobenius operators on reproducing kernel Banach spaces. Chaos: An Interdisciplinary Journal of Nonlinear Science, 32(12):123143, 12 2022.
- Boundedness of composition operators on higher order besov spaces in one dimension. Mathematische Annalen, May 2023.
- Isao Ishikawa. Bounded composition operators on functional quasi-banach spaces and stability of dynamical systems. Advances in Mathematics, 424:109048, 2023.
- Characterizing magnetized plasmas with dynamic mode decomposition. Physics of Plasmas, 27(3):032108, 03 2020.
- Yoshinobu Kawahara. Dynamic mode decomposition with reproducing kernels for Koopmanz spectral analysis. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 29. Curran Associates, Inc., 2016.
- Koopman analysis of quantum systems. Journal of Physics A: Mathematical and Theoretical, 55(31):314002, jul 2022.
- Eigendecompositions of transfer operators in reproducing kernel Hilbert spaces. Journal of Nonlinear Science, 30(1):283–315, Feb 2020.
- Natural operations in differential geometry. Springer-Verlag, Berlin, 1993.
- Hikosaburo Komatsu. Projective and injective limits of weakly compact sequences of locally convex spaces. Journal of the Mathematical Society of Japan, 19(3):366 – 383, 1967.
- B. O. Koopman. Hamiltonian systems and transformation in Hilbert space. Proc. Natl. Acad. Sci. USA, 17(5):315318, 1931.
- On convergence of extended dynamic mode decomposition to the Koopman operator. Journal of Nonlinear Science, 28(2):687–710, Apr 2018.
- Sharp spectral rates for Koopman operator learning. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
- Dynamic mode decomposition for financial trading strategies. Quantitative Finance, 16(11):1643–1655, 2016.
- A. Martineau. Sur la topologie des espaces de fonctions holomorphes. Mathematische Annalen, 163:62–88, 1966.
- Koopman-based lifting techniques for nonlinear systems identification. IEEE Transactions on Automatic Control, 65(6):2550–2565, 2020.
- A spectral operator-theoretic framework for global stability. In 52nd IEEE Conference on Decision and Control, pages 5234–5239, 2013.
- Global stability analysis using the eigenfunctions of the Koopman operator. IEEE Transactions on Automatic Control, 61(11):3356–3369, Nov 2016.
- Estimating Koopman operators with sketching to provably learn large scale dynamical systems. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
- Igor Mezić. Spectral properties of dynamical systems, model reduction and decompositions. Nonlinear Dynamics, 41(1):309–325, Aug 2005.
- Igor Mezić. Analysis of fluid flows via spectral properties of the Koopman operator. Annual Review of Fluid Mechanics, 45(1):357–378, 2013.
- Igor Mezić. Spectrum of the Koopman operator, spectral expansions in functional spaces, and state-space geometry. Journal of Nonlinear Science, 30(5):2091–2145, Oct 2020.
- Comparison of systems with complex behavior. Physica D: Nonlinear Phenomena, 197(1):101–133, 2004.
- Kernel mean embedding of distributions: A review and beyond. Foundations and Trends® in Machine Learning, 10(1-2):1–141, 2017.
- Juan A. Navarro González and Juan B. Sancho de Salas. C∞superscript𝐶C^{\infty}italic_C start_POSTSUPERSCRIPT ∞ end_POSTSUPERSCRIPT-differentiable spaces, volume 1824 of Lecture Notes in Mathematics. Springer-Verlag, Berlin, 2003.
- Eric A. Nordgren. Composition operators. Canadian Journal of Mathematics, 20:442–449, 1968.
- Koopman spectrum nonlinear regulator and provably efficient online learning. arXiv: 2106.15775, 2021.
- Discovering dynamic patterns from infectious disease data using dynamic mode decomposition. International Health, 7(2):139–145, 02 2015.
- Spectral analysis of nonlinear flows. Journal of Fluid Mechanics, 641:115–127, 2009.
- John V. Ryff. Subordinate Hpsuperscript𝐻𝑝H^{p}italic_H start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT functions. Duke Mathematical Journal, 33(2):347 – 354, 1966.
- Theory of reproducing kernels and applications, volume 44 of Developments in Mathematics. Springer, Singapore, 2016.
- Peter J. Schmid. Dynamic mode decomposition of experimental data. In Eighth International Symposium on Particle Image Velocimetry (PIV09), August 2009.
- Peter J. Schmid. Dynamic mode decomposition of numerical and experimental data. Journal of Fluid Mechanics, 656:5–28, 2010.
- Peter J. Schmid. Dynamic mode decomposition and its variants. Annual Review of Fluid Mechanics, 54(1):225–254, 2022.
- Dynamic mode decomposition for analytic maps. Communications in Nonlinear Science and Numerical Simulation, 84:105179, 2020.
- Composition operators on Hilbert spaces of entire functions with analytic symbols. Journal of Mathematical Analysis and Applications, 454(2):1019–1066, 2017.
- Nonlinear Koopman modes and coherency identification of coupled swing dynamics. IEEE Transactions on Power Systems, 26(4):1894–1904, 2011.
- Coherent swing instability of power grids. Journal of Nonlinear Science, 21(3):403–439, Jun 2011.
- Gábor Szegő. Orthogonal polynomials, volume Vol. XXIII of American Mathematical Society Colloquium Publications. American Mathematical Society, Providence, RI, fourth edition, 1975.
- Discriminant dynamic mode decomposition for labeled spatiotemporal data collections. SIAM Journal on Applied Dynamical Systems, 21(2):1030–1058, 2022.
- Learning dynamics models with stable invariant sets. Proceedings of the AAAI Conference on Artificial Intelligence, 35(11):9782–9790, May 2021.
- Learning koopman invariant subspaces for dynamic mode decomposition. In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017.
- Subspace dynamic mode decomposition for stochastic koopman analysis. Physical Review E, 96(3):033310, Sep 2017.
- Dynamic mode decomposition for plasma diagnostics and validation. Review of Scientific Instruments, 89(5):053501, 05 2018.
- A data–driven approximation of the Koopman operator: Extending dynamic mode decomposition. Journal of Nonlinear Science, 25(6):1307–1346, Dec 2015.
- A kernel-based method for data-driven koopman spectral analysis. Journal of Computational Dynamics, 2(2):247–265, 2015.
- Kôsaku Yosida. Functional analysis, volume 123 of Grundlehren der Mathematischen Wissenschaften. Springer-Verlag, Berlin-New York, sixth edition, 1980.
- Kahe Zhu. Operator theory in Function spaces: second edition, volume 138. Mathematical Surveys and Monographs, 2007.
- Kehe Zhu. Analysis on Fock spaces, volume 263 of Graduate Texts in Mathematics. Springer, New York, 2012.