Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
134 tokens/sec
GPT-4o
10 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Data/moment-driven approaches for fast predictive control of collective dynamics (2402.15611v1)

Published 23 Feb 2024 in math.OC, cs.LG, and cs.MA

Abstract: Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on fast online dynamic optimization at every time step. Two alternatives to MPC are proposed. First, the use of supervised learning techniques for the offline approximation of optimal feedback laws is discussed. Then, a procedure based on sequential linearization of the dynamics based on macroscopic quantities of the particle ensemble is reviewed. Both approaches circumvent the online solution of optimal control problems enabling fast, real-time, feedback synthesis for large-scale particle systems. Numerical experiments assess the performance of the proposed algorithms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (81)
  1. Vehicular traffic, crowds, and swarms: from kinetic theory and multiscale methods to applications and research perspectives. Math. Models Methods Appl. Sci., 29(10):1901–2005, 2019.
  2. Gradient-augmented supervised learning of optimal feedback laws using state-dependent Riccati equations. IEEE Control Systems Letters, 6:836–841, 2021.
  3. Supervised learning for kinetic consensus control. IFAC-PapersOnLine, 55(30):103–108, 2022.
  4. Invisible control of self-organizing agents leaving unknown environments. SIAM J. Appl. Math., 76(4):1683–1710, 2016.
  5. A data-driven kinetic model for opinion dynamics with social network contacts. prepint arXiv 2307.00906, 2023.
  6. Mean field control hierarchy. Appl. Math. Optim., 76(1):93–135, 2017.
  7. Moment-driven predictive control of mean-field collective dynamics. SIAM Journal on Control and Optimization, 60(2):814–841, 2022.
  8. Boltzmann-type control of opinion consensus through leaders. Philos. Trans. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci., 372(2028):20140138, 18, 2014.
  9. A. Alessio and A. Bemporad. A survey on explicit model predictive control. Nonlinear Model Predictive Control: Towards New Challenging Applications, pages 345–369, 2009.
  10. State-dependent riccati equation feedback stabilization for nonlinear pdes. Advances in Computational Mathematics, 49:1–32, 2021.
  11. N. Altmüller and L. Grüne. Distributed and boundary model predictive control for the heat equation. GAMM-Mitteilungen, 35(2):131–145, 2012.
  12. Optimal feedback law recovery by gradient-augmented sparse polynomial regression. Journal of Machine Learning Research, 22(48):1–32, 2021.
  13. Optimal consensus control of the Cucker-Smale model. IFAC-PapersOnLine, 51(13):1–6, 2018.
  14. Nonlinear feedback controllers and compensators: a state-dependent riccati equation approach. Computational Optimization and Applications, 37:177–218, 2007.
  15. Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations, Section 3.4, volume 12. Springer, 1997.
  16. E. N. Barron and R. Jensen. The pontryagin maximum principle from dynamic programming and viscosity solutions to first-order partial differential equations. Transactions of the American Mathematical Society, 298(2):635–641, 1986.
  17. N. Bellomo and J. Soler. On the mathematical theory of the dynamics of swarms viewed as complex systems. Math. Models Methods Appl. Sci., 22(suppl. 1):1140006, 29, 2012.
  18. The explicit linear quadratic regulator for constrained systems. Automatica, 38(1):3–20, 2002.
  19. Linear tracking MPC for nonlinear systems—part i: The model-based case. IEEE Transactions on Automatic Control, 67(9):4390–4405, 2022.
  20. On krause’s multi-agent consensus model with state-dependent connectivity. IEEE transactions on Automatic Control, 54(11):2586–2597, 2009.
  21. Instantaneous control of interacting particle systems in the mean-field limit. J. Comput. Phys., 405:109181, 20, 2020.
  22. A well-posedness theory in measures for some kinetic models of collective motion. Math. Models Methods Appl. Sci., 21(03):515–539, 2011.
  23. P. Cannarsa and H. Frankowska. Value function, relaxation, and transversality conditions in infinite horizon optimal control. Journal of Mathematical Analysis and Applications, 457(2):1188–1217, 2018. Special Issue on Convex Analysis and Optimization: New Trends in Theory and Applications.
  24. Sparse stabilization and control of alignment models. Math. Models Methods Appl. Sci., 25(3):521–564, 2015.
  25. The derivation of swarming models: mean-field limit and Wasserstein distances. In Collective dynamics from bacteria to crowds, pages 1–46. Springer, 2014.
  26. Particle, kinetic, and hydrodynamic models of swarming. In Mathematical modeling of collective behavior in socio-economic and life sciences, pages 297–336. Springer, 2010.
  27. Controlling swarms toward flocks and mills. SIAM Journal on Control and Optimization, 60(3):1863–1891, 2022.
  28. A collisionless singular Cucker-Smale model with decentralized formation control. SIAM J. Appl. Dyn. Syst., 18(4):1954–1981, 2019.
  29. The relationship between the maximum principle and dynamic programming. SIAM Journal on Control and Optimization, 25(5):1291–1311, 1987.
  30. On a kinetic model for a simple market economy. J. Stat. Phys., 120(1-2):253–277, 2005.
  31. Effective leadership and decision-making in animal groups on the move. Nature, 433(7025):513–516, 2005.
  32. Multiscale modeling of pedestrian dynamics, volume 12 of MS&A. Model. Simul. Appl. Springer, Cham, 2014.
  33. F. Cucker and S. Smale. Emergent behavior in flocks. IEEE Transactions on automatic control, 52(5):852–862, 2007.
  34. Modeling language evolution. Foundations of Computational Mathematics, 4:315–343, 2004.
  35. Hydrodynamic models of self-organized dynamics: derivation and existence theory. Methods Appl. Anal., 20(2):89–114, 2013.
  36. Optimizing semilinear representations for state-dependent riccati equation-based feedback control. IFAC-PapersOnLine, 55(30):510–515, 2022. 25th International Symposium on Mathematical Theory of Networks and Systems MTNS 2022.
  37. Data-driven tensor train gradient cross approximation for hamilton–jacobi–bellman equations. SIAM Journal on Scientific Computing, 45(5):A2153–A2184, 2023.
  38. Leadership, consensus decision making and collective behaviour in humans. Philos. Trans. Roy. Soc. B, 364(1518):781–789, 2009.
  39. Self-propelled particles with soft-core interactions: patterns, stability, and collapse. Phys. Rev. Lett., 96(10):104302, 2006.
  40. Event-based model predictive control for the cooperation of distributed agents. In 2012 Amer. Control Conf., pages 6473–6478, 2012.
  41. G. Estrada-Rodriguez and H. Gimperlein. Interacting particles with Lévy strategies: limits of transport equations for swarm robotic systems. SIAM J. Appl. Math., 80(1):476–498, 2020.
  42. Mean-field optimal control as gamma-limit of finite agent controls. European J. Appl. Math., 30(6):1153–1186, 2019.
  43. M. Fornasier and F. Solombrino. Mean-field optimal control. ESAIM Control Optim. Calc. Var., 20(4):1123–1152, 2014.
  44. G. Freudenthaler and T. Meurer. PDE-based multi-agent formation control using flatness and backstepping: analysis, design and robot experiments. Automatica, 115:108897, 13, 2020.
  45. Consensus convergence with stochastic effects. Vietnam J. Math., 45(1-2):51–75, 2017.
  46. The bounded confidence model of opinion dynamics. Math. Models Methods Appl. Sci., 22(2):1150007, 46, 2012.
  47. Emergent behavior of a cucker-smale type particle model with nonlinear velocity couplings. IEEE Transactions on Automatic Control, 55(7):1679–1683, 2010.
  48. Application of model reduction for model predictive control. IFAC Proceedings Volumes, 35(1):393–398, 2002. 15th IFAC World Congress.
  49. Resolving freeway jam waves by discrete first-order model-based predictive control of variable speed limits. Transportation Research Part C: Emerging Technologies, 77:405–420, 2017.
  50. M. Herty and D. Kalise. Suboptimal nonlinear feedback control laws for collective dynamics. In 2018 IEEE 14th International Conference on Control and Automation (ICCA), pages 556–561. IEEE, 2018.
  51. M. Herty and L. Pareschi. Fokker-Planck asymptotics for traffic flow models. Kinet. Relat. Models, 3(1):165–179, 2010.
  52. Mean–field control and Riccati equations. Netw. Heterog. Media, 10(3):699, 2015.
  53. M. Herty and C. Ringhofer. Averaged kinetic models for flows on unstructured networks. Kinet. Relat. Models, 4(4):1081–1096, 2011.
  54. R. Herzog and K. Kunisch. Algorithms for pde-constrained optimization. GAMM-Mitteilungen, 33(2):163–176, 2010.
  55. Learning-based model predictive control: Toward safe learning in control. Annual Review of Control, Robotics, and Autonomous Systems, 3(1):269–296, 2020.
  56. MPC for large-scale systems via model reduction and multiparametric quadratic programming. In Proceedings of the 45th IEEE Conference on Decision and Control, pages 3418–3423, 2006.
  57. Individual and mass behaviour in large population stochastic wireless power control problems: centralized and nash equilibrium solutions. In 42nd IEEE International Conference on Decision and Control (IEEE Cat. No. 03CH37475), volume 1, pages 98–103. IEEE, 2003.
  58. A. Jones and A. Astolfi. On the solution of optimal control problems using parameterized state-dependent Riccati equations. In 2020 59th IEEE Conference on Decision and Control (CDC), pages 1098–1103, 2020.
  59. Biologically inspired herding of animal groups by robots. Methods in Ecology and Evolution, 14(2):478–486, 2023.
  60. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. In Y. Bengio and Y. LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.
  61. J. Kocijan and R. Murray-Smith. Nonlinear Predictive Control with a Gaussian Process Model, pages 185–200. Springer Berlin Heidelberg, Berlin, Heidelberg, 2005.
  62. Predictive control with gaussian process models. In The IEEE Region 8 EUROCON 2003. Computer as a Tool., volume 1, pages 352–356 vol.1, 2003.
  63. Model learning predictive control in nonlinear dynamical systems. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 757–762, 2021.
  64. Learning-based nonlinear model predictive control. IFAC-PapersOnLine, 50(1):7769–7776, 2017. 20th IFAC World Congress.
  65. B. Lincoln and A. Rantzer. Relaxing dynamic programming. IEEE Transactions on Automatic Control, 51(8):1249–1260, 2006.
  66. A neural network architecture to learn explicit MPC controllers from data. IFAC-PapersOnLine, 53(2):11362–11367, 2020. 21st IFAC World Congress.
  67. Online learning-based model predictive control with gaussian process models and stability guarantees. International Journal of Robust and Nonlinear Control, 31(18):8785–8812, 2021.
  68. Dual MPC with reinforcement learning. IFAC-PapersOnLine, 49(7):266–271, 2016. 11th IFAC Symposium on Dynamics and Control of Process SystemsIncluding Biosystems DYCOPS-CAB 2016.
  69. S. Motsch and E. Tadmor. Heterophilious dynamics enhances consensus. SIAM review, 56(4):577–621, 2014.
  70. Integrating machine learning and model predictive control for automotive applications: A review and future directions. Engineering Applications of Artificial Intelligence, 120:105878, 2023.
  71. A survey of multi-agent formation control. Automatica, 53:424–440, 2015.
  72. Leader tracking in homogeneous vehicle platoons with broadcast delays. Automatica, 50(1):64–74, 2014.
  73. A deep learning architecture for predictive control. IFAC-PapersOnLine, 51(18):512–517, 2018. 10th IFAC Symposium on Advanced Control of Chemical Processes ADCHEM 2018.
  74. The mathematical theory of optimal processes, Chapter 1. Classics of Soviet Mathematics. Interscience Publishers John Wiley & Sons, Inc., 1962. Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt.
  75. Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments. Transp. Research Part C: Emerging Techn., 89:205–221, 2018.
  76. N. Subbotina. The method of characteristics for Hamilton—Jacobi equations and applications to dynamical optimization. Journal of mathematical sciences, 135:2955–3091, 2006.
  77. G. Toscani. Kinetic models of opinion formation. Commun. Math. Sci., 4(3):481–496, 2006.
  78. A. Tosin and M. Zanella. Kinetic-controlled hydrodynamics for traffic models with driver-assist vehicles. Multiscale Model. Simul., 17(2):716–749, 2019.
  79. I. J. Wolf and W. Marquardt. Fast NMPC schemes for regulatory and economic NMPC – a review. Journal of Process Control, 44:162–183, 2016.
  80. Machine learning-based reduced-order modeling and predictive control of nonlinear processes. Chemical Engineering Research and Design, 179:435–451, 2022.
  81. X. Zhou. Maximum principle, dynamic programming, and their connection in deterministic control. Journal of Optimization Theory and Applications, 65(2):363–373, 1990.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now