Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 134 tok/s
Gemini 2.5 Pro 41 tok/s Pro
GPT-5 Medium 24 tok/s Pro
GPT-5 High 22 tok/s Pro
GPT-4o 85 tok/s Pro
Kimi K2 192 tok/s Pro
GPT OSS 120B 428 tok/s Pro
Claude Sonnet 4.5 37 tok/s Pro
2000 character limit reached

Data-Augmented Predictive Deep Neural Network: Enhancing the extrapolation capabilities of non-intrusive surrogate models (2410.13376v1)

Published 17 Oct 2024 in cs.LG, cs.NA, and math.NA

Abstract: Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many methods fail in accurately generalizing in the entire time interval $[0, T]$, when the training data is available only in a training time interval $[0, T_0]$, with $T_0<T$. To improve the extrapolation capabilities of the surrogate models in the entire time domain, we propose a new deep learning framework, where kernel dynamic mode decomposition (KDMD) is employed to evolve the dynamics of the latent space generated by the encoder part of a convolutional autoencoder (CAE). After adding the KDMD-decoder-extrapolated data into the original data set, we train the CAE along with a feed-forward deep neural network using the augmented data. The trained network can predict future states outside the training time interval at any out-of-training parameter samples. The proposed method is tested on two numerical examples: a FitzHugh-Nagumo model and a model of incompressible flow past a cylinder. Numerical results show accurate and fast prediction performance in both the time and the parameter domain.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. Model Order Reduction, Volume 1: System- and Data-Driven Methods and Algorithms. De Gruyter, 2021. https://doi.org/10.1515/9783110498967.
  2. Model Order Reduction, Volume 2: Snapshot-Based Methods and Algorithms. De Gruyter, 2021. https://doi.org/10.1515/9783110671490.
  3. Model Order Reduction, Volume 3: Applications. De Gruyter, 2021. https://doi.org/10.1515/9783110499001.
  4. A survey of projection-based model reduction methods for parametric dynamical systems. SIAM Rev., 57(4):483–531, 2015. https://doi.org/10.1137/130932715.
  5. A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling. e-print 2403.10748, arXiv, 2024.
  6. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc. Natl. Acad. Sci. U.S.A., 113(15):3932–3937, 2016. https://doi.org/10.1073/pnas.1517384113.
  7. Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press, 2 edition, 2022.
  8. Data-driven discovery of coordinates and governing equations. Proc. Natl. Acad. Sci. U.S.A., 116(45):22445–22451, 2019. https://doi.org/10.1073/pnas.1906995116.
  9. S. Chaturantabut and D. C. Sorensen. Nonlinear model reduction via discrete empirical interpolation. SIAM J. Sci. Comput., 32(5):2737–2764, 2010. doi:10.1137/090766498.
  10. Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions. Computer Methods in Applied Mechanics and Engineering, 411:116072, 2023. https://doi.org/10.1016/j.cma.2023.116072.
  11. J. Duan and J. S. Hesthaven. Non-intrusive data-driven reduced-order modeling for time-dependent parametrized problems. J. Comput. Phys., 497:112621, 2024. https://doi.org/10.1016/j.jcp.2023.112621.
  12. A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs. J. Sci. Comput., 87:61, 2021. https://doi.org/10.1007/s10915-021-01462-7.
  13. Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models. Eng. Math., 5(6):1–36, 2023. https://doi.org/10.3934/mine.2023096.
  14. S. Fresca and A. Manzoni. POD-DL-ROM: Enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition. Computer Methods in Applied Mechanics and Engineering, 388:114181, 2022. https://doi.org/10.1016/j.cma.2021.114181.
  15. LaSDI: Parametric Latent Space Dynamics Identification. Computer Methods in Applied Mechanics and Engineering, 399:115436, 2022. doi:10.1016/j.cma.2022.115436.
  16. N. Geneva and N. Zabaras. Transformers for modeling physical systems. Neural Netw., 146:272–289, 2022. https://doi.org/10.1016/j.neunet.2021.11.022.
  17. S. Gugercin and A. C. Antoulas. A survey of model reduction by balanced truncation and some new results. Internat. J. Control, 77(8):748–766, 2004. https://doi.org/10.1080/00207170410001713448.
  18. J. Johns. Navier-Stokes: Incompressible flow with custom scenarios, 2018. https://github.com/JamieMJohns/Navier-stokes-2D-numerical-solve-incompressible-flow-with-custom-scenarios-MATLAB-.
  19. K. Lee and K. T. Carlberg. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders. J. Comput. Phys., 404:108973, 2020. doi:10.1016/j.jcp.2019.108973.
  20. Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the koopman operator. Chaos, 27(10), 2017. https://doi.org/10.1063/1.4993854.
  21. Deep learning for universal linear embeddings of nonlinear dynamics. Nat. Commun., 9(1):4950, 2018. https://doi.org/10.1038/s41467-018-07210-0.
  22. Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders. Phys. Fluids, 33(3), 2021. https://doi.org/10.1063/5.0039986.
  23. Non-intrusive surrogate modeling for parametrized time-dependent partial differential equations using convolutional autoencoders. Eng. Appl. Artif. Intell., 109:104652, 2022. https://doi.org/10.1016/j.engappai.2021.104652.
  24. Linearly recurrent autoencoder networks for learning dynamics. SIAM J. Appl. Dyn. Syst., 18(1):558–593, 2019. https://doi.org/10.1137/18M1177846.
  25. A. Quarteroni and G. Rozza. Reduced Order Methods for Modeling and Computational Reduction, volume 9 of MS&A – Modeling, Simulation and Applications. Springer International Publishing, Cham, Switzerland, 2014. doi:10.1007/978-3-319-02090-7.
  26. P. J. Schmid. Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech., 656:5–28, 2010. https://doi.org/10.1017/S0022112010001217.
  27. β𝛽\betaitalic_β-Variational autoencoders and transformers for reduced-order modelling of fluid flows. Nat. Commun., 15(1):1361, 2024.
  28. On dynamic mode decomposition: Theory and applications. J. Comput. Dyn., 1(2):391–421, 2014. https://doi.org/10.3934/jcd.2014.1.391.
  29. A data–driven approximation of the Koopman operator: Extending dynamic mode decomposition. J. Nonlinear Sci., 25(6):1307–1346, 2015.
  30. A kernel-based method for data-driven Koopman spectral analysis. J. Comput. Dyn., 2(2):247–265, 2015.
  31. J. Xu and K. Duraisamy. Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics. Computer Methods in Applied Mechanics and Engineering, 372:113379, 2020. doi:10.1016/j.cma.2020.113379.

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.