2000 character limit reached
Stable Linear Subspace Identification: A Machine Learning Approach
Published 6 Nov 2023 in eess.SY, cs.LG, and cs.SY | (2311.03197v4)
Abstract: Machine Learning (ML) and linear System Identification (SI) have been historically developed independently. In this paper, we leverage well-established ML tools - especially the automatic differentiation framework - to introduce SIMBa, a family of discrete linear multi-step-ahead state-space SI methods using backpropagation. SIMBa relies on a novel Linear-Matrix-Inequality-based free parametrization of Schur matrices to ensure the stability of the identified model. We show how SIMBa generally outperforms traditional linear state-space SI methods, and sometimes significantly, although at the price of a higher computational burden. This performance gap is particularly remarkable compared to other SI methods with stability guarantees, where the gain is frequently above 25% in our investigations, hinting at SIMBa's ability to simultaneously achieve state-of-the-art fitting performance and enforce stability. Interestingly, these observations hold for a wide variety of input-output systems and on both simulated and real-world data, showcasing the flexibility of the proposed approach. We postulate that this new SI paradigm presents a great extension potential to identify structured nonlinear models from data, and we hence open-source SIMBa on https://github.com/Cemempamoi/simba.
- L. Ljung, “System identification,” in Signal analysis and prediction. Springer, 1998, pp. 163–173.
- J. Degrave, F. Felici, J. Buchli, M. Neunert, B. Tracey, F. Carpanese, T. Ewalds, R. Hafner, A. Abdolmaleki, D. de Las Casas et al., “Magnetic control of tokamak plasmas through deep reinforcement learning,” Nature, vol. 602, no. 7897, pp. 414–419, 2022.
- LeCun, Yann and Bengio, Yoshua and Hinton, Geoffrey, “Deep learning,” nature, vol. 521, no. 7553, pp. 436–444, 2015.
- P. Werbos, “Beyond regression: New tools for prediction and analysis in the behavioral sciences,” PhD thesis, Committee on Applied Mathematics, Harvard University, Cambridge, MA, 1974.
- L. Ljung, C. Andersson, K. Tiels, and T. B. Schön, “Deep learning and system identification,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 1175–1181, 2020.
- M. Forgione and D. Piga, “Continuous-time system identification with neural networks: Model structures and fitting criteria,” European Journal of Control, vol. 59, pp. 69–81, 2021.
- D. Gedon, N. Wahlström, T. B. Schön, and L. Ljung, “Deep state space models for nonlinear system identification,” IFAC-PapersOnLine, vol. 54, no. 7, pp. 481–486, 2021.
- G. I. Beintema, M. Schoukens, and R. Tóth, “Deep subspace encoders for nonlinear system identification,” Automatica, vol. 156, p. 111210, 2023.
- D. Masti and A. Bemporad, “Learning nonlinear state–space models using autoencoders,” Automatica, vol. 129, p. 109666, 2021.
- K. R. Muske and J. B. Rawlings, “Model predictive control with linear models,” AIChE Journal, vol. 39, no. 2, pp. 262–287, 1993.
- M. Schoukens, “Improved initialization of state-space artificial neural networks,” in 2021 European Control Conference (ECC). IEEE, 2021, pp. 1913–1918.
- J. C. Schulze and A. Mitsos, “Data-Driven Nonlinear Model Reduction Using Koopman Theory: Integrated Control Form and NMPC Case Study,” IEEE Control Systems Letters, vol. 6, pp. 2978–2983, 2022.
- J. Drgoňa, A. Tuor, E. Skomski, S. Vasisht, and D. Vrabie, “Deep learning explicit differentiable predictive control laws for buildings,” IFAC-PapersOnLine, vol. 54, no. 6, pp. 14–19, 2021.
- G. Armenise, M. Vaccari, R. B. Di Capaci, and G. Pannocchia, “An open-source system identification package for multivariable processes,” in 2018 UKACC 12th International Conference on Control (CONTROL). IEEE, 2018, pp. 152–157.
- S. J. Qin, “An overview of subspace identification,” Computers & chemical engineering, vol. 30, no. 10-12, pp. 1502–1513, 2006.
- S. J. Qin, W. Lin, and L. Ljung, “A novel subspace identification approach with enforced causal models,” Automatica, vol. 41, no. 12, pp. 2043–2053, 2005.
- S. J. Qin and L. Ljung, “Parallel QR implementation of subspace identification with parsimonious models,” IFAC Proceedings Volumes, vol. 36, no. 16, pp. 1591–1596, 2003.
- G. Pannocchia and M. Calosi, “A predictor form PARSIMonious algorithm for closed-loop subspace identification,” Journal of Process Control, vol. 20, no. 4, pp. 517–524, 2010.
- I. R. Manchester, M. Revay, and R. Wang, “Contraction-based methods for stable identification and robust machine learning: a tutorial,” in 2021 60th IEEE Conference on Decision and Control (CDC). IEEE, 2021, pp. 2955–2962.
- J. M. Maciejowski, “Guaranteed stability with subspace methods,” Systems & Control Letters, vol. 26, no. 2, pp. 153–156, 1995.
- W.-b. Huang, L. le Cao, F. Sun, D. Zhao, H. Liu, and S. Yu, “Learning Stable Linear Dynamical Systems with the Weighted Least Square Method.” in IJCAI, vol. 1599, 2016, p. 1605.
- B. Boots, G. J. Gordon, and S. Siddiqi, “A constraint generation approach to learning stable linear dynamical systems,” Advances in neural information processing systems, vol. 20, 2007.
- S. L. Lacy and D. S. Bernstein, “Subspace identification with guaranteed stability using constrained optimization,” IEEE Transactions on automatic control, vol. 48, no. 7, pp. 1259–1263, 2003.
- N. Gillis, M. Karow, and P. Sharma, “A note on approximating the nearest stable discrete-time descriptor systems with fixed rank,” Applied Numerical Mathematics, vol. 148, pp. 131–139, 2020.
- W. Jongeneel, T. Sutter, and D. Kuhn, “Efficient learning of a linear dynamical system with stability guarantees,” IEEE Transactions on Automatic Control, 2022.
- G. Mamakoukas, I. Abraham, and T. D. Murphey, “Learning stable models for prediction and control,” IEEE Transactions on Robotics, 2023.
- J. Drgoňa, A. R. Tuor, V. Chandan, and D. L. Vrabie, “Physics-constrained deep learning of multi-zone building thermal dynamics,” Energy and Buildings, vol. 243, p. 110992, 2021.
- J. Z. Kolter and G. Manek, “Learning stable deep dynamics models,” Advances in neural information processing systems, vol. 32, 2019.
- M. Revay, R. Wang, and I. R. Manchester, “Recurrent equilibrium networks: Flexible dynamic models with guaranteed stability and robustness,” IEEE Transactions on Automatic Control, 2023.
- M. Zakwan, L. Di Natale, B. Svetozarevic, P. Heer, C. N. Jones, and G. F. Trecate, “Physically consistent neural ODEs for learning multi-physics systems,” arXiv preprint arXiv:2211.06130, 2022.
- K. Loya, J. Buzhardt, and P. Tallapragada, “Koopman operator based predictive control with a data archive of observables,” ASME Letters in Dynamic Systems and Control, pp. 1–7, 2023.
- M. A. Lones, “How to avoid machine learning pitfalls: a guide for academic researchers,” arXiv preprint arXiv:2108.02497, 2021.
- M. Chilali and P. Gahinet, “H/sub/spl infin//design with pole placement constraints: an lmi approach,” IEEE Transactions on automatic control, vol. 41, no. 3, pp. 358–367, 1996.
- L. Di Natale, M. Zakwan, P. Heer, G. F. Trecate, and C. N. Jones, “SIMBa: System Identification Methods leveraging Backpropagation,” arXiv preprint arXiv:2311.13889, 2023.
- B. De Moor, P. De Gersem, B. De Schutter, and W. Favoreel, “DAISY: A database for identification of systems,” JOURNAL A, vol. 38, no. 4, p. 5, 1997.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.