Collocation methods for nonlinear differential equations on low-rank manifolds (2402.18721v3)
Abstract: We introduce new methods for integrating nonlinear differential equations on low-rank manifolds. These methods rely on interpolatory projections onto the tangent space, enabling low-rank time integration of vector fields that can be evaluated entry-wise. A key advantage of our approach is that it does not require the vector field to exhibit low-rank structure, thereby overcoming significant limitations of traditional dynamical low-rank methods based on orthogonal projection. To construct the interpolatory projectors, we develop a sparse tensor sampling algorithm based on the discrete empirical interpolation method (DEIM) that parameterizes tensor train manifolds and their tangent spaces with cross interpolation. Using these projectors, we propose two time integration schemes on low-rank tensor train manifolds. The first scheme integrates the solution at selected interpolation indices and constructs the solution with cross interpolation. The second scheme generalizes the well-known orthogonal projector-splitting integrator to interpolatory projectors. We demonstrate the proposed methods with applications to several tensor differential equations arising from the discretization of partial differential equations.
- Ground state structures in ordered binary alloys with second neighbor interactions. Acta Metallurgica, 20(3):423–433, 1972.
- C. Cercignani. The Boltzmann equation and its applications. Springer, 1988.
- G. Ceruti and C. Lubich. An unconventional robust integrator for dynamical low-rank approximation. BIT Numerical Mathematics, 62(1):23–44, Mar 2022.
- Time integration of tree tensor networks. SIAM J. Num. Anal., 59(1):289–313, 2021.
- S. Chaturantabut and D. C. Sorensen. Nonlinear model reduction via discrete empirical interpolation. SIAM Journal on Scientific Computing, 32(5):2737–2764, 2010.
- Randomized algorithms for rounding in the tensor-train format. SIAM Journal on Scientific Computing, 45(1):A74–A95, 2023.
- Rank-adaptive tensor methods for high-dimensional nonlinear PDEs. J. Sci. Comput., 88(36):1–27, 2021.
- A. Dektor and D. Venturi. Dynamically orthogonal tensor methods for high-dimensional nonlinear PDEs. J. Comput. Phys., 404:109125, 2020.
- A. Dektor and D. Venturi. Dynamic tensor approximation of high-dimensional nonlinear PDEs. J. Comput. Phys., 437:110295, 2021.
- A. Dektor and D. Venturi. Tensor rank reduction via coordinate flows. J. Comput. Phys., 491:112378, 2023.
- A. Dektor and D. Venturi. Coordinate-adaptive integration of pdes on tensor manifolds. Communications on Applied Mathematics and Computation, 2024.
- S. Dolgov and D. Savostyanov. Parallel cross interpolation for high-precision calculation of high-dimensional integrals. Computer Physics Communications, 246:106869, 2020.
- Oblique projection for scalable rank-adaptive reduced-order modelling of nonlinear stochastic partial differential equations with time-dependent bases. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 479(2278):20230320, 2023.
- Unnormalized optimal transport. J. Comput. Phys., 399:108940, 2019.
- B. Ghahremani and H. Babaee. A DEIM Tucker tensor cross algorithm and its application to dynamical low-rank approximation. arXiv:2401.04249, pages 1–23, 2024.
- Spectral methods for time-dependent problems, volume 21 of Cambridge Monographs on Applied and Computational Mathematics. Cambridge University Press, Cambridge, 2007.
- On manifolds of tensors of fixed TT-rank. Numer. Math., 120(4):701–731, 2012.
- Fourth-order time-stepping for stiff PDEs. SIAM Journal on Scientific Computing, 26(4):1214–1233, 2005.
- E. Kieri and B. Vandereycken. Projection methods for dynamical low-rank approximation of high-dimensional problems. Comput. Methods Appl. Math., 19(1):73–92, 2019.
- D. Kressner and C. Tobler. Algorithm 941: Htucker—a matlab toolbox for tensors in hierarchical tucker format. 40(3), 2014.
- Time integration of tensor trains. SIAM J. Numer. Anal., 53(2):917–941, 2015.
- M. H. Naderi and H. Babaee. Adaptive sparse interpolation for accelerating nonlinear stochastic reduced-order modeling with time-dependent bases. Computer Methods in Applied Mechanics and Engineering, 405:115813, 2023.
- I. Oseledets and E. Tyrtyshnikov. TT-cross approximation for multidimensional arrays. Linear Algebra and its Applications, 432(1):70–88, 2010.
- I. V. Oseledets. Tensor-train decomposition. SIAM J. Sci. Comput., 33(5):2295––2317, 2011.
- Stability of discrete empirical interpolation and gappy proper orthogonal decomposition with randomized and deterministic sampling points. SIAM Journal on Scientific Computing, 42(5):A2837–A2864, 2020.
- Error analysis of tensor-train cross approximation. Advances in Neural Information Processing Systems, 35:14236–14249, 2022.
- H. Risken. The Fokker-Planck equation: methods of solution and applications. Springer-Verlag, second edition, 1989. Mathematics in science and engineering, vol. 60.
- Adaptive integration of nonlinear evolution equations on tensor manifolds. J. Sci. Comput., 92(39):1–31, 2022.
- D. Savostyanov. Quasioptimality of maximum-volume cross interpolation of tensors. Linear Algebra Appl., 458:217–244, 2014.
- D. C. Sorensen and M. Embree. A DEIM induced CUR factorization. SIAM Journal on Scientific Computing, 38(3):A1454–A1482, 2016.
- A. Uschmajew and B. Vandereycken. The geometry of algorithms using hierarchical tensors. Linear Algebra Appl., 439(1):133–166, 2013.
- D. Venturi. The numerical approximation of nonlinear functionals and functional differential equations. Physics Reports, 732:1–102, 2018.
- D. Venturi and A. Dektor. Spectral methods for nonlinear functionals and functional differential equations. Res. Math. Sci., 8(27):1–39, 2021.