Papers
Topics
Authors
Recent
Search
2000 character limit reached

Learning-based model augmentation with LFRs

Published 2 Apr 2024 in eess.SY and cs.SY | (2404.01901v3)

Abstract: Nonlinear system identification (NL-SI) has proven to be effective in obtaining accurate models for highly complex systems. In particular, recent encoder-based methods for artificial neural networks state-space (ANN-SS) models have achieved state-of-the-art performance on various benchmarks, while offering consistency and computational efficiency. Inclusion of prior knowledge of the system can be exploited to increase (i) estimation speed, (ii) accuracy, and (iii) interpretability of the resulting models. This paper proposes an encoder-based model augmentation method that incorporates prior knowledge from first-principles (FP) models. We introduce a novel \linear-fractional-representation (LFR) model structure that allows for the unified representation of various augmentation structures including the ones that are commonly used in the literature, and an identification algorithm for estimating the proposed structure together with appropriate initialization methods. The performance and generalization capabilities of the proposed method are demonstrated in a hardening mass-spring-damper simulation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. J. A. Suykens, B. L. De Moor, and J. Vandewalle, “Nonlinear system identification using neural state space models, applicable to robust control design,” International Journal of Control, vol. 62, no. 1, pp. 129–152, 1995.
  2. M. Schoukens, “Improved initialization of state-space artificial neural networks,” in Proc. of the 2021 European Control Conference, 2021, pp. 1913–1918.
  3. G. I. Beintema, M. Schoukens, and R. Tóth, “Deep subspace encoders for nonlinear system identification,” Automatica, vol. 156, p. 111210, 2023.
  4. M. Forgione and D. Piga, “Continuous-time system identification with neural networks: Model structures and fitting criteria,” European Journal of Control, vol. 59, pp. 69–81, 2021.
  5. C. Verhoek, G. I. Beintema, S. Haesaert, M. Schoukens, and R. Tóth, “Deep-learning-based identification of lpv models for nonlinear systems,” in Proc. of the 2022 IEEE 61st Conference on Decision and Control.   IEEE, 2022, pp. 3274–3280.
  6. J. Willard, X. Jia, S. Xu, M. Steinbach, and V. Kumar, “Integrating scientific knowledge with machine learning for engineering and environmental systems,” ACM Computing Surveys, vol. 55, no. 4, pp. 1–37, 2022.
  7. A. Daw, A. Karpatne, W. D. Watkins, J. S. Read, and V. Kumar, “Physics-guided neural networks (pgnn): An application in lake temperature modeling,” in Knowledge Guided Machine Learning.   Chapman and Hall/CRC, 2022, pp. 353–372.
  8. D. C. Psichogios and L. H. Ungar, “A hybrid neural network-first principles approach to process modeling,” AIChE Journal, vol. 38, no. 10, pp. 1499–1511, 1992.
  9. J. Pathak, A. Wikner, R. Fussell, S. Chandra, B. R. Hunt, M. Girvan, and E. Ott, “Hybrid forecasting of chaotic processes: Using machine learning in conjunction with a knowledge-based model,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 28, no. 4, 2018.
  10. R.-S. Götte and J. Timmermann, “Composed physics-and data-driven system identification for non-autonomous systems in control engineering,” in Proc. of the 3rd International Conference on Artificial Intelligence, Robotics and Control, 2022, pp. 67–76.
  11. B. Sohlberg and E. W. Jacobsen, “Grey box modelling–branches and experiences,” IFAC Proceedings Volumes, vol. 41, no. 2, pp. 11 415–11 420, 2008.
  12. M. L. Thompson and M. A. Kramer, “Modeling chemical processes using prior knowledge and neural networks,” AIChE Journal, vol. 40, no. 8, pp. 1328–1340, 1994.
  13. B. Sun, C. Yang, Y. Wang, W. Gui, I. Craig, and L. Olivier, “A comprehensive hybrid first principles/machine learning modeling framework for complex industrial processes,” Journal of Process Control, vol. 86, pp. 30–43, 2020.
  14. M. Schoukens and R. Tóth, “On the initialization of nonlinear LFR model identification with the best linear approximation,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 310–315, 2020.
  15. L. Hewing, D. Gramlich, C. Verhoek, J. Veenman, R. Polonio, C. Ardura, R. Tóth, C. Ebenbauer, C. W. Scherer, and V. Preda, “Enhancing the guidance, navigation and control of autonomous parafoils using machine learning methods,” in Proc. of the 12th International Conference on Guidance, Navigation & Control Systems, 2023, pp. 1–15.
  16. M. Schoukens and R. Tóth, “Linear parameter varying representation of a class of MIMO nonlinear systems,” IFAC-PapersOnLine, vol. 51, no. 26, pp. 94–99, 2018.
  17. M. Bolderman, H. Butler, S. Koekebakker, E. van Horssen, R. Kamidi, T. Spaan-Burke, N. Strijbosch, and M. Lazar, “Physics-guided neural networks for feedforward control with input-to-state-stability guarantees,” Control Engineering Practice, vol. 145, p. 105851, 2024.
  18. C. Bishop, “Neural networks for pattern recognition,” Clarendon Press google scholar, vol. 2, pp. 223–228, 1995.
  19. D. Masti and A. Bemporad, “Learning nonlinear state–space models using autoencoders,” Automatica, vol. 129, p. 109666, 2021.
  20. G. I. Beintema, R. Tóth, and M. Schoukens, “Non-linear state-space model identification from video data using deep encoders,” IFAC-PapersOnLine, vol. 54, no. 7, pp. 697–701, 2021.
Citations (1)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.