2000 character limit reached
SIFt-RLS: Subspace of Information Forgetting Recursive Least Squares (2404.10844v1)
Published 16 Apr 2024 in eess.SP, cs.SY, and eess.SY
Abstract: This paper presents subspace of information forgetting recursive least squares (SIFt-RLS), a directional forgetting algorithm which, at each step, forgets only in row space of the regressor matrix, or the \textit{information subspace}. As a result, SIFt-RLS tracks parameters that are in excited directions while not changing parameter estimation in unexcited directions. It is shown that SIFt-RLS guarantees an upper and lower bound of the covariance matrix, without assumptions of persistent excitation, and explicit bounds are given. Furthermore, sufficient conditions are given for the uniform Lyapunov stability and global uniform exponential stability of parameter estimation error in SIFt-RLS when estimating fixed parameters without noise. SIFt-RLS is compared to other RLS algorithms from the literature in a numerical example without persistently exciting data.
- Adaptive control. Courier Corporation, 2013.
- Dennis S Bernstein. Matrix mathematics: theory, facts, and formulas. Princeton university press, 2009.
- Convergence and exponential convergence of identification algorithms with directional forgetting factor. Automatica, 26(5):929–932, 1990.
- Convergence and consistency of recursive least squares with variable-rate forgetting. Automatica, 119:109052, 2020.
- A directional forgetting algorithm based on the decomposition of the information matrix. Automatica, 36(11):1725–1731, 2000.
- Rank modifications of semidefinite matrices associated with a secant update formula. SIAM Journal on Matrix Analysis and Applications, 20(2):428–436, 1998.
- S. Dasgupta and Yih-Fang Huang. Asymptotically convergent modified recursive least-squares with data-dependent updating and forgetting factor for systems with bounded noise. IEEE Transactions on Information Theory, 33(3):383–392, 1987.
- Implementation of self-tuning regulators with variable forgetting factors. Automatica, 17(6):831–835, 1981.
- A new recursive least squares method with multiple forgetting schemes. In 2015 54th IEEE conference on decision and control (CDC), pages 3367–3372. IEEE, 2015.
- Recursive least squares with variable-direction forgetting: Compensating for the loss of persistency [lecture notes]. IEEE Control Systems Magazine, 40(4):80–102, 2020.
- Deterministic convergence of a self-tuning regulator with covariance resetting. In IEEE Proceedings D-Control Theory and Applications, volume 130, pages 6–8, 1983.
- W. M. Haddad and V. Chellaboina. Nonlinear Dynamical Systems and Control: A Lyapunov-based Approach. Princeton University Press, 2008.
- Matrix analysis. Cambridge university press, 2012.
- Syed Aseem Ul Islam and Dennis S Bernstein. Recursive least squares for real-time implementation [lecture notes]. IEEE Control Systems Magazine, 39(3):82–85, 2019.
- Exponential convergence of recursive least squares with exponential forgetting factor. Systems & Control Letters, 2(2):77–82, 1982.
- R Kulhavỳ and M Kárnỳ. Tracking of slowly varying parameters by directional forgetting. IFAC Proceedings Volumes, 17(2):687–692, 1984.
- Exponential resetting and cyclic resetting recursive least squares. IEEE Control Systems Letters, 7:985–990, 2023.
- Generalized forgetting recursive least squares: Stability and robustness guarantees. arXiv preprint arXiv:2308.04259, 2023.
- Regularization-induced bias and consistency in recursive least squares. In 2021 American Control Conference (ACC), pages 3987–3992. IEEE, 2021.
- Gradient-based variable forgetting factor rls algorithm in time-varying environments. IEEE Transactions on Signal Processing, 53(8):3141–3150, 2005.
- Theory and practice of recursive identification. MIT press, 1983.
- Some issues on the practical use of recursive least squares identification in self-tuning control. International Journal of Control, 53(5):1021–1033, 1991.
- Recursive least squares with variable-rate forgetting based on the f-test. In 2022 American Control Conference (ACC), pages 3937–3942. IEEE, 2022.
- Predictive cost adaptive control: A numerical investigation of persistency, consistency, and exigency. IEEE Control Systems Magazine, 41(6):64–96, 2021.
- On modified parameter estimators for identification and adaptive control. a unified framework and some new schemes. Annual Reviews in Control, 50:278–293, 2020.
- A robust variable forgetting factor recursive least-squares algorithm for system identification. IEEE Signal Processing Letters, 15:597–600, 2008.
- A practical variable forgetting factor recursive least-squares algorithm. In 2014 11th International symposium on electronics and telecommunications (ISETC), pages 1–4. IEEE, 2014.
- Recursive forgetting algorithms. International Journal of Control, 55(1):109–128, 1992.
- Modified least squares algorithm incorporating exponential resetting and forgetting. International Journal of Control, 47(2):477–491, 1988.
- Adaptive control: stability, convergence, and robustness, 1990.
- Continuous-time least-squares forgetting algorithms for indirect adaptive control. European Journal of Control, 62:105–112, 2021.
- A new exponential forgetting algorithm for recursive least-squares parameter estimation. arXiv preprint arXiv:2004.03910, 2020.
- Numerical linear algebra, volume 181. Siam, 2022.
- Recursive least squares with forgetting for online estimation of vehicle mass and road grade: theory and experiments. Vehicle System Dynamics, 43(1):31–55, 2005.
- Recursive least squares identification with variable-direction forgetting via oblique projection decomposition. IEEE/CAA Journal of Automatica Sinica, 9(3):547–555, 2021.