Data-Augmented Predictive Deep Neural Network: Enhancing the extrapolation capabilities of non-intrusive surrogate models (2410.13376v1)
Abstract: Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many methods fail in accurately generalizing in the entire time interval $[0, T]$, when the training data is available only in a training time interval $[0, T_0]$, with $T_0<T$. To improve the extrapolation capabilities of the surrogate models in the entire time domain, we propose a new deep learning framework, where kernel dynamic mode decomposition (KDMD) is employed to evolve the dynamics of the latent space generated by the encoder part of a convolutional autoencoder (CAE). After adding the KDMD-decoder-extrapolated data into the original data set, we train the CAE along with a feed-forward deep neural network using the augmented data. The trained network can predict future states outside the training time interval at any out-of-training parameter samples. The proposed method is tested on two numerical examples: a FitzHugh-Nagumo model and a model of incompressible flow past a cylinder. Numerical results show accurate and fast prediction performance in both the time and the parameter domain.
- Model Order Reduction, Volume 1: System- and Data-Driven Methods and Algorithms. De Gruyter, 2021. https://doi.org/10.1515/9783110498967.
- Model Order Reduction, Volume 2: Snapshot-Based Methods and Algorithms. De Gruyter, 2021. https://doi.org/10.1515/9783110671490.
- Model Order Reduction, Volume 3: Applications. De Gruyter, 2021. https://doi.org/10.1515/9783110499001.
- A survey of projection-based model reduction methods for parametric dynamical systems. SIAM Rev., 57(4):483–531, 2015. https://doi.org/10.1137/130932715.
- A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling. e-print 2403.10748, arXiv, 2024.
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc. Natl. Acad. Sci. U.S.A., 113(15):3932–3937, 2016. https://doi.org/10.1073/pnas.1517384113.
- Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press, 2 edition, 2022.
- Data-driven discovery of coordinates and governing equations. Proc. Natl. Acad. Sci. U.S.A., 116(45):22445–22451, 2019. https://doi.org/10.1073/pnas.1906995116.
- S. Chaturantabut and D. C. Sorensen. Nonlinear model reduction via discrete empirical interpolation. SIAM J. Sci. Comput., 32(5):2737–2764, 2010. doi:10.1137/090766498.
- Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions. Computer Methods in Applied Mechanics and Engineering, 411:116072, 2023. https://doi.org/10.1016/j.cma.2023.116072.
- J. Duan and J. S. Hesthaven. Non-intrusive data-driven reduced-order modeling for time-dependent parametrized problems. J. Comput. Phys., 497:112621, 2024. https://doi.org/10.1016/j.jcp.2023.112621.
- A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs. J. Sci. Comput., 87:61, 2021. https://doi.org/10.1007/s10915-021-01462-7.
- Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models. Eng. Math., 5(6):1–36, 2023. https://doi.org/10.3934/mine.2023096.
- S. Fresca and A. Manzoni. POD-DL-ROM: Enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition. Computer Methods in Applied Mechanics and Engineering, 388:114181, 2022. https://doi.org/10.1016/j.cma.2021.114181.
- LaSDI: Parametric Latent Space Dynamics Identification. Computer Methods in Applied Mechanics and Engineering, 399:115436, 2022. doi:10.1016/j.cma.2022.115436.
- N. Geneva and N. Zabaras. Transformers for modeling physical systems. Neural Netw., 146:272–289, 2022. https://doi.org/10.1016/j.neunet.2021.11.022.
- S. Gugercin and A. C. Antoulas. A survey of model reduction by balanced truncation and some new results. Internat. J. Control, 77(8):748–766, 2004. https://doi.org/10.1080/00207170410001713448.
- J. Johns. Navier-Stokes: Incompressible flow with custom scenarios, 2018. https://github.com/JamieMJohns/Navier-stokes-2D-numerical-solve-incompressible-flow-with-custom-scenarios-MATLAB-.
- K. Lee and K. T. Carlberg. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders. J. Comput. Phys., 404:108973, 2020. doi:10.1016/j.jcp.2019.108973.
- Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the koopman operator. Chaos, 27(10), 2017. https://doi.org/10.1063/1.4993854.
- Deep learning for universal linear embeddings of nonlinear dynamics. Nat. Commun., 9(1):4950, 2018. https://doi.org/10.1038/s41467-018-07210-0.
- Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders. Phys. Fluids, 33(3), 2021. https://doi.org/10.1063/5.0039986.
- Non-intrusive surrogate modeling for parametrized time-dependent partial differential equations using convolutional autoencoders. Eng. Appl. Artif. Intell., 109:104652, 2022. https://doi.org/10.1016/j.engappai.2021.104652.
- Linearly recurrent autoencoder networks for learning dynamics. SIAM J. Appl. Dyn. Syst., 18(1):558–593, 2019. https://doi.org/10.1137/18M1177846.
- A. Quarteroni and G. Rozza. Reduced Order Methods for Modeling and Computational Reduction, volume 9 of MS&A – Modeling, Simulation and Applications. Springer International Publishing, Cham, Switzerland, 2014. doi:10.1007/978-3-319-02090-7.
- P. J. Schmid. Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech., 656:5–28, 2010. https://doi.org/10.1017/S0022112010001217.
- β𝛽\betaitalic_β-Variational autoencoders and transformers for reduced-order modelling of fluid flows. Nat. Commun., 15(1):1361, 2024.
- On dynamic mode decomposition: Theory and applications. J. Comput. Dyn., 1(2):391–421, 2014. https://doi.org/10.3934/jcd.2014.1.391.
- A data–driven approximation of the Koopman operator: Extending dynamic mode decomposition. J. Nonlinear Sci., 25(6):1307–1346, 2015.
- A kernel-based method for data-driven Koopman spectral analysis. J. Comput. Dyn., 2(2):247–265, 2015.
- J. Xu and K. Duraisamy. Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics. Computer Methods in Applied Mechanics and Engineering, 372:113379, 2020. doi:10.1016/j.cma.2020.113379.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.