Density Stabilization Strategies for Nonholonomic Agents on Compact Manifolds (2308.15755v2)
Abstract: In this article, we consider the problem of stabilizing stochastic processes, which are constrained to a bounded Euclidean domain or a compact smooth manifold, to a given target probability density. Most existing works on modeling and control of robotic swarms that use PDE models assume that the robots' dynamics are holonomic, and hence, the associated stochastic processes have generators that are elliptic. We relax this assumption on the ellipticity of the generator of the stochastic processes, and consider the more practical case of the stabilization problem for a swarm of agents whose dynamics are given by a controllable driftless control-affine system. We construct state-feedback control laws that exponentially stabilize a swarm of nonholonomic agents to a target probability density that is sufficiently regular. State-feedback laws can stabilize a swarm only to target probability densities that are positive everywhere. To stabilize the swarm to probability densities that possibly have disconnected supports, we introduce a semilinear PDE model of a collection of interacting agents governed by a hybrid switching diffusion process. The interaction between the agents is modeled using a (mean-field) feedback law that is a function of the local density of the swarm, with the switching parameters as the control inputs. We show that the semilinear PDE system is globally asymptotically stable about the given target probability density. The stabilization strategies are verified without inter-agent interactions is verified numerically for agents that evolve according to the Brockett integrator and a nonholonomic system on the special orthogonal group of 3-dimensional rotations $SO(3)$. The stabilization strategy with inter-agent interactions is verified numerically for agents that evolve according to the Brockett integrator and a holonomic system on the sphere $S2$.
- Markov chain approach to probabilistic guidance for swarms of autonomous agents. Asian Journal of Control, 17(4):1105–1124, 2015.
- A comprehensive introduction to sub-Riemannian geometry, volume 181. Cambridge University Press, 2019.
- The intrinsic hypoelliptic Laplacian and its heat kernel on unimodular lie groups. Journal of Functional Analysis, 256(8):2621–2655, 2009.
- Control theory from the geometric viewpoint, volume 87. Springer Science & Business Media, 2013.
- Alessandro Astolfi. Discontinuous control of the Brockett integrator. European Journal of Control, 4(1):49–63, 1998.
- Thierry Aubin. Some nonlinear problems in Riemannian geometry. Springer Science & Business Media, 2013.
- Log-Sobolev inequalities for subelliptic operators satisfying a generalized curvature dimension inequality. Journal of Functional Analysis, 262(6):2646–2676, 2012.
- A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numerische Mathematik, 84(3):375–393, 2000.
- Optimized stochastic policies for task allocation in swarms of robots. IEEE Transactions on Robotics, 25(4):927–937, 2009.
- Multi-robot coverage and exploration on Riemannian manifolds with boundaries. The International Journal of Robotics Research, 33(1):113–137, 2014.
- Stabilization of nonlinear discrete-time systems to target measures using stochastic feedback laws. IEEE Transactions on Automatic Control, 66(5):1957–1972, 2020.
- Stabilization of multi-agent systems to target distributions using local interactions. IFAC-PapersOnLine, 54(9):60–65, 2021.
- The Pontryagin maximum principle in the Wasserstein space. Calculus of Variations and Partial Differential Equations, 58(1):11, 2019.
- Marco Bramanti. An invitation to hypoelliptic operators and Hörmander’s vector fields. Springer, 2014.
- Roger W. Brockett. Asymptotic stability and feedback stabilization. In R. W. Brockett, R. S. Millman, and H. J. Sussmann, editors, Differential Geometric Control Theory, volume 27, pages 181–191. Birkhauser, Boston, 1983.
- Geometric control of mechanical systems: modeling, analysis, and design for simple mechanical control systems, volume 49. Springer, 2019.
- Gaussian lower bound for the Neumann Green function of a general parabolic operator. Positivity, 19(3):625–646, 2015.
- Coverage control for mobile sensing networks. IEEE Transactions on Robotics and Automation, 20(2):243–255, 2004.
- Criterion of positivity for semilinear problems with applications in biology. Positivity, 21(4):1383–1392, 2017.
- Coverage and field estimation on bounded domains by diffusive swarms. In IEEE Conference on Decision and Control (CDC), pages 2867–2874, 2016.
- Nonlinear generalizations of diffusion-based coverage by robotic swarms. In 2018 IEEE Conference on Decision and Control (CDC), pages 1341–1346. IEEE, 2018.
- Mean-field models in swarm robotics: A survey. Bioinspiration & Biomimetics, 15(1):015001, 2019.
- Mean-field stabilization of robotic swarms to probability distributions with disconnected supports. In 2018 Annual American Control Conference (ACC), pages 885–892. IEEE, 2018.
- PDE-based optimization for stochastic mapping and coverage strategies using robotic ensembles. Automatica, 95:356–367, 2018.
- Bilinear controllability of a class of advection–diffusion–reaction systems. IEEE Transactions on Automatic Control, 64(6):2282–2297, 2018.
- One-Parameter Semigroups for Linear Evolution Equations, volume 194. Springer Science & Business Media, 2000.
- Velocity field generation for density control of swarms using heat equation and smoothing kernels. IFAC-PapersOnLine, 50(1):9405–9411, 2017.
- Lawrence C. Evans. Partial differential equations. Graduate Studies in Mathematics, 19, 1998.
- Mean-field optimal control. ESAIM: Control, Optimisation and Calculus of Variations, 20(4):1123–1152, 2014.
- Isoperimetric and Sobolev inequalities for Carnot-Carathéodory spaces and the existence of minimal surfaces. Communications on Pure and Applied Mathematics, 49(10):1081–1144, 1996.
- Styled-velocity flocking of autonomous vehicles: A systematic design. IEEE Transactions on Automatic Control, 60(8), 2015.
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Communications in Information & Systems, 6(3):221–252, 2006.
- The functional calculus for the Laplacian on Lipschitz domains. Journées Equations aux Dérivées Partielles, pages 1–10, 1989.
- Estimates for the heat kernel for a sum of squares of vector fields. Indiana University Mathematics Journal, 35(4):835–854, 1986.
- Brownian motion. In Brownian Motion and Stochastic Calculus, pages 47–127. Springer, 1998.
- Nonlinear systems. Prentice Hall, Upper Saddle River, NJ, 3rd edition, 2002.
- JJ Kohn. Pseudo-differential operators and. Partial differential equations, 23:61, 1973.
- Vassili N. Kolokoltsov. Nonlinear Markov processes and kinetic equations, volume 182. Cambridge University Press, 2010.
- Distributed optimal transport for the deployment of swarms. In 2018 IEEE Conference on Decision and Control (CDC), pages 4583–4588. IEEE, 2018.
- Mean field games. Japanese Journal of Mathematics, 2(1):229–260, 2007.
- John M. Lee. Smooth manifolds. In Introduction to smooth manifolds, pages 1–31. Springer, 2013.
- John M. Lee. Introduction to Riemannian manifolds. Springer, 2018.
- Taeyoung Lee. Bayesian attitude estimation with the matrix fisher distribution on so (3). IEEE Transactions on Automatic Control, 63(10):3377–3392, 2018.
- Alessandra Lunardi. Analytic Semigroups and Optimal Regularity in Parabolic Problems. Springer Science & Business Media, 2012.
- Distributed robot ensemble control for deployment to multiple sites. Robotics: Science and Systems VII, 2011.
- Closed-loop task allocation in robot swarms using inter-robot encounters. Swarm Intelligence, 13(2):115–143, 2019.
- Henry P. McKean. Propagation of chaos for a class of non-linear parabolic equations. Stochastic Differential Equations (Lecture Series in Differential Equations, Session 7, Catholic Univ., 1967), pages 41–57, 1967.
- Jump control of probability densities with applications to autonomous vehicle motion. IEEE Transactions on Automatic Control, 57(10):2588–2598, 2012.
- Optimotaxis: A stochastic multi-agent optimization procedure with point measurements. In International Workshop on Hybrid Systems: Computation and Control, pages 358–371. Springer, 2008.
- Duy-Minh Nhieu. The Neumann problem for sub-Laplacians on Carnot groups and the extension theorem for Sobolev spaces. Annali di Matematica Pura ed Applicata, 180(1):1–25, 2001.
- El-Maati Ouhabaz. Analysis of Heat Equations on Domains (LMS-31). Princeton University Press, 2009.
- Control to flocking of the kinetic Cucker–Smale model. SIAM Journal on Mathematical Analysis, 47(6):4685–4719, 2015.
- Andrey Pilipenko. An Introduction to Stochastic Differential Equations with Reflection, volume 1. Universitätsverlag Potsdam, 2014.
- Hannes Risken. Fokker-Planck equation. In The Fokker-Planck Equation, pages 63–95. Springer, 1996.
- Francesco Rossi. Large time behavior for the heat equation on Carnot groups. Nonlinear Differential Equations and Applications NoDEA, 20(3):1393–1407, 2013.
- Tomáš Roubíček. Nonlinear partial differential equations with applications, volume 153. Springer Science & Business Media, 2013.
- Consensus optimization on manifolds. SIAM Journal on Control and Optimization, 48(1):56–76, 2009.
- Konrad Schmüdgen. Unbounded Self-Adjoint Operators on Hilbert Space, volume 265. Springer Science & Business Media, 2012.
- Hiroshi Tanaka. Stochastic differential equations with reflecting boundary condition in convex regions. Hiroshima Mathematical Journal, 9(1):163–177, 1979.
- Krystyna Twardowska. Wong-Zakai approximations for stochastic differential equations. Acta Applicandae Mathematica, 43(3):317–359, 1996.
- Gabriele Valentini. Achieving consensus in robot swarms. Studies in Computational Intelligence, 706, 2017.
- Analysis and Geometry on Groups, volume 100. Cambridge University Press, 2008.
- Design of ant-inspired stochastic control policies for collective transport by robotic swarms. Swarm Intelligence, 8(4):303–327, 2014.
- Hybrid Switching Diffusions: Properties and Applications, volume 63. Springer New York, 2010.