Koopman-Based Surrogate Modelling of Turbulent Rayleigh-Bénard Convection (2405.06425v1)
Abstract: Several related works have introduced Koopman-based Machine Learning architectures as a surrogate model for dynamical systems. These architectures aim to learn non-linear measurements (also known as observables) of the system's state that evolve by a linear operator and are, therefore, amenable to model-based linear control techniques. So far, mainly simple systems have been targeted, and Koopman architectures as reduced-order models for more complex dynamics have not been fully explored. Hence, we use a Koopman-inspired architecture called the Linear Recurrent Autoencoder Network (LRAN) for learning reduced-order dynamics in convection flows of a Rayleigh B\'enard Convection (RBC) system at different amounts of turbulence. The data is obtained from direct numerical simulations of the RBC system. A traditional fluid dynamics method, the Kernel Dynamic Mode Decomposition (KDMD), is used to compare the LRAN. For both methods, we performed hyperparameter sweeps to identify optimal settings. We used a Normalized Sum of Square Error measure for the quantitative evaluation of the models, and we also studied the model predictions qualitatively. We obtained more accurate predictions with the LRAN than with KDMD in the most turbulent setting. We conjecture that this is due to the LRAN's flexibility in learning complicated observables from data, thereby serving as a viable surrogate model for the main structure of fluid dynamics in turbulent convection settings. In contrast, KDMD was more effective in lower turbulence settings due to the repetitiveness of the convection flow. The feasibility of Koopman-based surrogate models for turbulent fluid flows opens possibilities for efficient model-based control techniques useful in a variety of industrial settings.
- S. Pandey, P. Teutsch, P. Mäder, and J. Schumacher, “Direct data-driven forecast of local turbulent heat flux in Rayleigh–Bénard convection,” Physics of Fluids, vol. 34, no. 4, p. 045106, Apr. 2022.
- A. Chatterjee, “An introduction to the proper orthogonal decomposition,” Current Science, vol. 78, no. 7, 2000.
- S. Pawar, S. M. Rahman, H. Vaddireddy, O. San, A. Rasheed, and P. Vedula, “A deep learning enabler for nonintrusive reduced order modeling of fluid flows,” Physics of Fluids, vol. 31, no. 8, p. 085101, Aug. 2019.
- S. L. Brunton, B. W. Brunton, J. L. Proctor, and J. N. Kutz, “Koopman Invariant Subspaces and Finite Linear Representations of Nonlinear Dynamical Systems for Control,” PLOS ONE, vol. 11, no. 2, p. e0150171, Feb. 2016, publisher: Public Library of Science.
- P. J. Schmid, “Dynamic mode decomposition of numerical and experimental data,” Journal of Fluid Mechanics, vol. 656, p. 5–28, 2010.
- M. O. Williams, I. G. Kevrekidis, and C. W. Rowley, “A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition,” Journal of Nonlinear Science, vol. 25, no. 6, pp. 1307–1346, Dec. 2015.
- M. O. Williams, C. W. Rowley, and I. G. Kevrekidis, “A kernel-based method for data-driven koopman spectral analysis,” Journal of Computational Dynamics, vol. 2, no. 2, pp. 247–265, 2015.
- B. O. Koopman, “Hamiltonian Systems and Transformation in Hilbert Space,” Proceedings of the National Academy of Sciences of the United States of America, vol. 17, no. 5, pp. 315–318, May 1931.
- C. W. Rowley, I. Mezić, S. Bagheri, P. Schlatter, and D. S. Henningson, “Spectral analysis of nonlinear flows,” Journal of Fluid Mechanics, vol. 641, pp. 115–127, Dec. 2009.
- S. L. Brunton, M. Budišić, E. Kaiser, and J. N. Kutz, “Modern Koopman Theory for Dynamical Systems,” SIAM Review, vol. 64, no. 2, pp. 229–340, May 2022.
- B. Lusch, J. N. Kutz, and S. L. Brunton, “Deep learning for universal linear embeddings of nonlinear dynamics,” Nature Communications, vol. 9, no. 1, p. 4950, Nov. 2018.
- S. E. Otto and C. W. Rowley, “Linearly Recurrent Autoencoder Networks for Learning Dynamics,” SIAM Journal on Applied Dynamical Systems, vol. 18, no. 1, pp. 558–593, Jan. 2019.
- M. Bonnert and U. Konigorski, “Estimating Koopman Invariant Subspaces of Excited Systems Using Artificial Neural Networks,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 1156–1162, Jan. 2020.
- N. Takeishi, Y. Kawahara, and T. Yairi, “Learning Koopman Invariant Subspaces for Dynamic Mode Decomposition,” in Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc., 2017.
- E. Yeung, S. Kundu, and N. Hodas, “Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems,” in 2019 American Control Conference (ACC). IEEE, Jul. 2019, pp. 4832–4839.
- H. Klie and H. Florez, “Data-Driven Prediction of Unconventional Shale-Reservoir Dynamics,” SPE Journal, vol. 25, no. 05, pp. 2564–2581, Oct. 2020.
- J. Morton, F. D. Witherden, A. Jameson, and M. J. Kochenderfer, “Deep dynamical modeling and control of unsteady fluid flows,” in Proceedings of the 32nd International Conference on Neural Information Processing Systems, Red Hook, NY, USA, Dec. 2018, pp. 9278–9288.
- J. C. Schulze, D. T. Doncevic, and A. Mitsos, “Identification of MIMO Wiener-type Koopman models for data-driven model reduction using deep learning,” Computers & Chemical Engineering, vol. 161, p. 107781, May 2022.
- T. Zhao, M. Yue, and J. Wang, “Deep-Learning-Based Koopman Modeling for Online Control Synthesis of Nonlinear Power System Transient Dynamics,” IEEE Transactions on Industrial Informatics, vol. 19, no. 10, pp. 10 444–10 453, Oct. 2023.
- A. Pandey, J. D. Scheel, and J. Schumacher, “Turbulent superstructures in Rayleigh-Bénard convection,” Nature Communications, vol. 9, no. 1, p. 2118, May 2018.
- G. Beintema, A. Corbetta, L. Biferale, and F. Toschi, “Controlling Rayleigh–Bénard convection via reinforcement learning,” Journal of Turbulence, vol. 21, no. 9-10, pp. 585–605, Oct. 2020.
- “Demo - Rayleigh Benard — shenfun 4.1.4 documentation.” [Online]. Available: https://shenfun.readthedocs.io/en/latest/rayleighbenard.html
- M. Mortensen, “Shenfun: High performance spectral galerkin computing platform,” Journal of Open Source Software, vol. 3, no. 31, p. 1071, 2018.
- ——, “Shenfun - automating the spectral galerkin method,” in MekIT’17 - Ninth national conference on Computational Mechanics, B. H. Skallerud and H. I. Andersson, Eds. International Center for Numerical Methods in Engineering (CIMNE), 2017, pp. 273–298.
- C. Vignon, J. Rabault, J. Vasanth, F. Alcántara-Ávila, M. Mortensen, and R. Vinuesa, “Effective control of two-dimensional Rayleigh–Bénard convection: Invariant multi-agent reinforcement learning is all you need,” Physics of Fluids, vol. 35, no. 6, p. 065146, 06 2023.
- D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” in 3rd International Conference for Learning Representations, 2015.