Learning-based model augmentation with LFRs (2404.01901v2)
Abstract: Nonlinear system identification (NL-SI) has proven to be effective in obtaining accurate models for highly complex systems. Especially, recent encoder-based methods for artificial neural networks state-space (ANN-SS) models have achieved state-of-the-art performance on various benchmarks, while offering consistency and computational efficiency. The inclusion of prior knowledge of the system can be exploited to increase (i) estimation speed, (ii) accuracy, and (iii) interpretability of the resulting models. This paper proposes an encoder based model augmentation method incorporating prior knowledge from first-principles (FP) models. We introduce a novel linear-fractional-representation (LFR) model structure that allows for the unified representation of various augmentation structures including the ones that are commonly used in the literature, and an identification algorithm for estimating the proposed structure together with appropriate initialization methods. The performance and generalization capabilities of the proposed method are demonstrated on a hardening mass-spring-damper simulation.
- J. A. Suykens, B. L. De Moor, and J. Vandewalle, “Nonlinear system identification using neural state space models, applicable to robust control design,” International Journal of Control, vol. 62, no. 1, pp. 129–152, 1995.
- M. Schoukens, “Improved initialization of state-space artificial neural networks,” in Proc. of the 2021 European Control Conference, 2021, pp. 1913–1918.
- G. I. Beintema, M. Schoukens, and R. Tóth, “Deep subspace encoders for nonlinear system identification,” Automatica, vol. 156, p. 111210, 2023.
- M. Forgione and D. Piga, “Continuous-time system identification with neural networks: Model structures and fitting criteria,” European Journal of Control, vol. 59, pp. 69–81, 2021.
- C. Verhoek, G. I. Beintema, S. Haesaert, M. Schoukens, and R. Tóth, “Deep-learning-based identification of lpv models for nonlinear systems,” in Proc. of the 2022 IEEE 61st Conference on Decision and Control. IEEE, 2022, pp. 3274–3280.
- J. Willard, X. Jia, S. Xu, M. Steinbach, and V. Kumar, “Integrating scientific knowledge with machine learning for engineering and environmental systems,” ACM Computing Surveys, vol. 55, no. 4, pp. 1–37, 2022.
- A. Daw, A. Karpatne, W. D. Watkins, J. S. Read, and V. Kumar, “Physics-guided neural networks (pgnn): An application in lake temperature modeling,” in Knowledge Guided Machine Learning. Chapman and Hall/CRC, 2022, pp. 353–372.
- D. C. Psichogios and L. H. Ungar, “A hybrid neural network-first principles approach to process modeling,” AIChE Journal, vol. 38, no. 10, pp. 1499–1511, 1992.
- J. Pathak, A. Wikner, R. Fussell, S. Chandra, B. R. Hunt, M. Girvan, and E. Ott, “Hybrid forecasting of chaotic processes: Using machine learning in conjunction with a knowledge-based model,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 28, no. 4, 2018.
- R.-S. Götte and J. Timmermann, “Composed physics-and data-driven system identification for non-autonomous systems in control engineering,” in Proc. of the 3rd International Conference on Artificial Intelligence, Robotics and Control, 2022, pp. 67–76.
- B. Sohlberg and E. W. Jacobsen, “Grey box modelling–branches and experiences,” IFAC Proceedings Volumes, vol. 41, no. 2, pp. 11 415–11 420, 2008.
- M. L. Thompson and M. A. Kramer, “Modeling chemical processes using prior knowledge and neural networks,” AIChE Journal, vol. 40, no. 8, pp. 1328–1340, 1994.
- B. Sun, C. Yang, Y. Wang, W. Gui, I. Craig, and L. Olivier, “A comprehensive hybrid first principles/machine learning modeling framework for complex industrial processes,” Journal of Process Control, vol. 86, pp. 30–43, 2020.
- M. Schoukens and R. Tóth, “On the initialization of nonlinear LFR model identification with the best linear approximation,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 310–315, 2020.
- L. Hewing, D. Gramlich, C. Verhoek, J. Veenman, R. Polonio, C. Ardura, R. Tóth, C. Ebenbauer, C. W. Scherer, and V. Preda, “Enhancing the guidance, navigation and control of autonomous parafoils using machine learning methods,” in Proc. of the 12th International Conference on Guidance, Navigation & Control Systems, 2023, pp. 1–15.
- M. Schoukens and R. Tóth, “Linear parameter varying representation of a class of MIMO nonlinear systems,” IFAC-PapersOnLine, vol. 51, no. 26, pp. 94–99, 2018.
- M. Bolderman, H. Butler, S. Koekebakker, E. van Horssen, R. Kamidi, T. Spaan-Burke, N. Strijbosch, and M. Lazar, “Physics-guided neural networks for feedforward control with input-to-state-stability guarantees,” Control Engineering Practice, vol. 145, p. 105851, 2024.
- C. Bishop, “Neural networks for pattern recognition,” Clarendon Press google scholar, vol. 2, pp. 223–228, 1995.
- D. Masti and A. Bemporad, “Learning nonlinear state–space models using autoencoders,” Automatica, vol. 129, p. 109666, 2021.
- G. I. Beintema, R. Tóth, and M. Schoukens, “Non-linear state-space model identification from video data using deep encoders,” IFAC-PapersOnLine, vol. 54, no. 7, pp. 697–701, 2021.