Data-Driven Robust Covariance Control for Uncertain Linear Systems (2312.05833v2)
Abstract: The theory of covariance control and covariance steering (CS) deals with controlling the dispersion of trajectories of a dynamical system, under the implicit assumption that accurate prior knowledge of the system being controlled is available. In this work, we consider the problem of steering the distribution of a discrete-time, linear system subject to exogenous disturbances under an unknown dynamics model. Leveraging concepts from behavioral systems theory, the trajectories of this unknown, noisy system may be (approximately) represented using system data collected through experimentation. Using this fact, we formulate a direct data-driven covariance control problem using input-state data. We then propose a maximum likelihood uncertainty quantification method to estimate and bound the noise realizations in the data collection process. Lastly, we utilize robust convex optimization techniques to solve the resulting norm-bounded uncertain convex program. We illustrate the proposed end-to-end data-driven CS algorithm on a double integrator example and showcase the efficacy and accuracy of the proposed method compared to that of model-based methods
- E. Bakolas. Optimal covariance control for discrete-time stochastic linear systems subject to constraints. In 55th IEEE Conference on Decision and Control (CDC), pages 1153–1158, Las Vegas, NV, Dec. 12–14, 2016.
- Robust Optimization, volume 28 of Princeton Series in Applied Mathematics. Princeton University Press, 2009.
- P. Billingsley. Probability and Measure. Wiley, 2008.
- Data-driven control via Petersen’s lemma. Automatica, 145:110537, 2022. ISSN 0005-1098.
- C. De Persis and P. Tesi. Formulas for data-driven control: Stabilization, optimality, and robustness. IEEE Transactions on Automatic Control, 65(3):909–924, 2020.
- On the role of regularization in direct data-driven LQR control. In 61st IEEE Conference on Decision and Control (CDC), pages 1091–1098, Cancún, Mexico, Dec. 6–9, 2022.
- On the certainty-equivalence approach to direct data-driven LQR design. IEEE Transactions on Automatic Control, pages 1–8, 2023.
- A. Feldbaum. Dual control theory problems. IFAC Proceedings Volumes, 1(2):541–550, 1963.
- M. Gevers. Identification for control: From the early achievements to the revival of experiment design. European Journal of Control, 11(4):335–352, 2005.
- Covariance control theory. International Journal of Control, 46(1):13–32, 1987.
- Safe high-performance autonomous off-road driving using covariance steering stochastic model predictive control. IEEE Transactions on Control Systems Technology, 31(5):2066–2081, 2023.
- T. Lipp and S. Boyd. Variations and extension of the convex–concave procedure. Optimization and Engineering, 17(2):263–287, 2016.
- Optimal covariance steering for discrete-time linear stochastic systems, 2023. arXiv: 2211.00618.
- J. Lofberg. YALMIP: A toolbox for modeling and optimization in MATLAB. In IEEE International Symposium on Computer Aided Control Systems Design, pages 284–289, Taipei, Taiwan, 2004.
- I. Markovsky and F. Dörfler. Behavioral systems theory in data-driven analysis, signal processing, and control. Annual Reviews in Control, 52:42–64, 2021.
- Data-driven control based on the behavioral approach: From theory to applications in power systems. IEEE Control Systems Magazine, 43(5):28–68, 2023.
- W. K. Newey and D. McFadden. Chapter 36 large sample estimation and hypothesis testing. volume 4 of Handbook of Econometrics, pages 2111–2245. Elsevier, 1994.
- K. Okamoto and P. Tsiotras. Optimal stochastic vehicle path planning using covariance steering. IEEE Robotics and Automation Letters, 4(3):2276–2281, 2019.
- J. Pilipovsky and P. Tsiotras. Covariance steering with optimal risk allocation. IEEE Transactions on Aerospace and Electronic Systems, 57(6):3719–3733, 2021.
- J. Pilipovsky and P. Tsiotras. Data-driven covariance steering control design. In 62nd IEEE Conference on Decision and Control, Marina Bay, Singapore, Dec. 13–15, 2023.
- G. Rapakoulias and P. Tsiotras. Discrete-time optimal covariance steering via semidefinite programming. In 62nd IEEE Conference on Decision and Control, Marina Bay, Singapore, Dec. 13–15, 2023.
- Distributionally robust covariance steering with optimal risk allocation. In American Control Conference (ACC), pages 2607–2614, San Diego, CA, May 31 – June 2, 2023.
- Chance-constrained covariance control for low-thrust minimum-fuel trajectory optimization. In AAS/AIAA Astrodynamics Specialist Conference, Lake Tahoe, CA, Aug 9–13, 2020.
- Data-driven linear quadratic regulation via semidefinite programming. IFAC-PapersOnLine, 53(2):3995–4000, 2020. 21st IFAC World Congress.
- Distributed model predictive covariance steering, 2022. arXiv:2212.00398.
- Distribution steering for discrete-time linear systems with general disturbances using characteristic functions. In American Control Conference (ACC), pages 4183–4190, Atlanta, Georgia, June 8–10, 2022.
- P. Stoica and B. C. Ng. On the Cramer-Rao bound under parametric constraints. IEEE Signal Processing Letters, 5(7):177–179, 1998.
- A note on persistency of excitation. In 43rd IEEE Conference on Decision and Control (CDC), volume 3, pages 2630–2631, Atlantis, Paradise, Bahamas, Dec 14-17, 2004.
- A. L. Yuille and A. Rangarajan. The concave-convex procedure (CCCP). In Advances in Neural Information Processing Systems, volume 14. MIT Press, 2001.
- H. Zhang and F. Ding. On the kronecker products and their applications. Journal of Applied Mathematics, 2013:Article ID 296185, 2013.