Goal-Reaching Trajectory Design Near Danger with Piecewise Affine Reach-avoid Computation (2402.15604v4)
Abstract: Autonomous mobile robots must maintain safety, but should not sacrifice performance, leading to the classical reach-avoid problem: find a trajectory that is guaranteed to reach a goal and avoid obstacles. This paper addresses the near danger case, also known as a narrow gap, where the agent starts near the goal, but must navigate through tight obstacles that block its path. The proposed method builds off the common approach of using a simplified planning model to generate plans, which are then tracked using a high-fidelity tracking model and controller. Existing approaches use reachability analysis to overapproximate the error between these models and ensure safety, but doing so introduces numerical approximation error conservativeness that prevents goal-reaching. The present work instead proposes a Piecewise Affine Reach-avoid Computation (PARC) method to tightly approximate the reachable set of the planning model. PARC significantly reduces conservativeness through a careful choice of the planning model and set representation, along with an effective approach to handling time-varying tracking errors. The utility of this method is demonstrated through extensive numerical experiments in which PARC outperforms state-of-the-art reach avoid methods in near-danger goal reaching. Furthermore, in a simulated demonstration, PARC enables the generation of provably-safe extreme vehicle dynamics drift parking maneuvers. A preliminary hardware demo on a TurtleBot3 also validates the method.
- “Reach-avoid problems with time-varying dynamics, targets and constraints” In Proceedings of the 18th international conference on hybrid systems: computation and control, 2015, pp. 11–20
- Bowen Alpern and Fred B Schneider “Defining liveness” In Information processing letters 21.4 Elsevier, 1985, pp. 181–185
- “Data-driven safety filters: Hamilton-jacobi reachability, control barrier functions, and predictive methods for uncertain systems” In IEEE Control Systems Magazine 43.5 IEEE, 2023, pp. 137–177
- Kai-Chieh Hsu, Haimin Hu and Jaime Fernández Fisac “The safety filter: A unified view of safety-critical control in autonomous systems” In arXiv preprint arXiv:2309.05837, 2023
- “Fastrack: a modular framework for real-time motion planning and guaranteed safe tracking” In IEEE Transactions on Automatic Control 66.12 IEEE, 2021, pp. 5861–5876
- “Multi-rate control design under input constraints via fixed-time barrier functions” In IEEE Control Systems Letters 6 IEEE, 2021, pp. 608–613
- “Funnel libraries for real-time robust feedback motion planning” In The International Journal of Robotics Research 36.8 SAGE Publications Sage UK: London, England, 2017, pp. 947–982
- “LQR-trees: Feedback motion planning via sums-of-squares verification” In The International Journal of Robotics Research 29.8 SAGE Publications Sage UK: London, England, 2010, pp. 1038–1052
- “Bridging the gap between safety and real-time performance in receding-horizon trajectory design for mobile robots” In The International Journal of Robotics Research 39.12 SAGE Publications Sage UK: London, England, 2020, pp. 1419–1469
- Shreyas Kousik, Patrick Holmes and Ram Vasudevan “Safe, aggressive quadrotor flight via reachability-based trajectory design” In Dynamic Systems and Control Conference 59162, 2019, pp. V003T19A010 American Society of Mechanical Engineers
- “Reach-avoid problems via sum-or-squares optimization and dynamic programming” In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 4325–4332 IEEE
- Matthias Althoff, Goran Frehse and Antoine Girard “Set propagation techniques for reachability analysis” In Annual Review of Control, Robotics, and Autonomous Systems 4 Annual Reviews, 2021, pp. 369–395
- Somil Bansal and Claire J Tomlin “Deepreach: A deep learning approach to high-dimensional reachability” In 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 1817–1824 IEEE
- “Reachability-based Trajectory Design with Neural Implicit Safety Constraints” In arXiv preprint arXiv:2302.07352, 2023
- “Safe nonlinear control using robust neural lyapunov-barrier functions” In Conference on Robot Learning, 2022, pp. 1724–1735 PMLR
- “Barriernet: Differentiable control barrier functions for learning of safe robot control” In IEEE Transactions on Robotics IEEE, 2023
- “Safe reinforcement learning using black-box reachability analysis” In IEEE Robotics and Automation Letters 7.4 IEEE, 2022, pp. 10665–10672
- F. Christophersen “Optimal Control of Constrained Piecewise Affine Systems”, Lecture Notes in Control and Information Sciences Springer Berlin Heidelberg, 2007 URL: https://books.google.com/books?id=l6VrcwQ9W4kC
- “Robust model predictive control for piecewise affine systems subject to bounded disturbances” In IFAC Proceedings Volumes 39.5 Elsevier, 2006, pp. 329–334
- Eric C Kerrigan and David Q Mayne “Optimal control of constrained, piecewise affine systems with bounded disturbances” In Proceedings of the 41st IEEE Conference on Decision and Control, 2002. 2, 2002, pp. 1552–1557 IEEE
- Sasa V Rakovic and David Q Mayne “Robust time optimal obstacle avoidance problem for constrained discrete time systems” In Proceedings of the 44th IEEE Conference on Decision and Control, 2005, pp. 981–986 IEEE
- “Multi-parametric toolbox 3.0” In 2013 European control conference (ECC), 2013, pp. 502–510 IEEE
- Matthias Althoff “An Introduction to CORA 2015” In ARCH@ CPSWeek 34 Citeseer, 2015, pp. 120–151
- “Robust constrained control of piecewise affine systems through set-based reachability computations” In International Journal of Robust and Nonlinear Control 30.15 Wiley Online Library, 2020, pp. 5989–6020
- “Optimization-based control for dynamic legged robots” In IEEE Transactions on Robotics IEEE, 2023
- Joseph A Vincent and Mac Schwager “Reachable polyhedral marching (rpm): A safety verification algorithm for robotic systems with deep neural network components” In 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 9029–9035 IEEE
- “Constrained zonotopes: A new tool for set-based estimation and fault detection” In Automatica 69 Elsevier, 2016, pp. 126–136
- Daniel Heß, Matthias Althoff and Thomas Sattel “Formal verification of maneuver automata for parameterized motion primitives” In 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2014, pp. 1474–1481 IEEE
- C.P. Grant “Theory of Ordinary Differential Equations” CreateSpace Independent Publishing Platform, 2014 URL: https://books.google.com/books?id=h3nZrQEACAAJ
- “Towards provably not-at-fault control of autonomous robots in arbitrary dynamic environments” In arXiv preprint arXiv:1902.02851, 2019
- Nathan J Kong, George Council and Aaron M Johnson “iLQR for piecewise-smooth hybrid dynamical systems” In 2021 60th IEEE Conference on Decision and Control (CDC), 2021, pp. 5374–5381 IEEE
- “A new methodology for piecewise affine models using Voronoi partitions” In Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, 2009, pp. 3920–3925 IEEE
- “Gusto: Guaranteed sequential trajectory optimization via sequential convex programming” In 2019 International conference on robotics and automation (ICRA), 2019, pp. 6741–6747 IEEE
- “Random walks on polytopes and an affine interior point method for linear programming” In Proceedings of the forty-first annual ACM symposium on Theory of computing, 2009, pp. 561–570
- “Fast MCMC sampling algorithms on polytopes” In The Journal of Machine Learning Research 19.1 JMLR. org, 2018, pp. 2146–2231
- Mato Baotić “Polytopic computations in constrained optimal control” In Automatika: časopis za automatiku, mjerenje, elektroniku, računarstvo i komunikacije 50.3-4 KoREMA-Hrvatsko društvo za komunikacije, računarstvo, elektroniku, mjerenja …, 2009, pp. 119–134
- “Reachability-based trajectory safeguard (RTS): A safe and fast reinforcement learning safety layer for continuous control” In IEEE Robotics and Automation Letters 6.2 IEEE, 2021, pp. 3663–3670
- Mark W Mueller, Markus Hehn and Raffaello D’Andrea “A computationally efficient motion primitive for quadrocopter trajectory generation” In IEEE transactions on robotics 31.6 IEEE, 2015, pp. 1294–1310
- Jonathan Y Goh and J Christian Gerdes “Simultaneous stabilization and tracking of basic automobile drifting trajectories” In 2016 IEEE Intelligent Vehicles Symposium (IV), 2016, pp. 597–602 IEEE
- Jonathan Y Goh, Tushar Goel and J Christian Gerdes “Toward automated vehicle control beyond the stability limits: drifting along a general path” In Journal of Dynamic Systems, Measurement, and Control 142.2 American Society of Mechanical Engineers, 2020, pp. 021004
- Tushar Goel, Jonathan Y Goh and J Christian Gerdes “Opening new dimensions: Vehicle motion planning and control using brakes while drifting” In 2020 IEEE Intelligent Vehicles Symposium (IV), 2020, pp. 560–565 IEEE
- Trey P Weber and J Christian Gerdes “Modeling and Control for Dynamic Drifting Trajectories” In IEEE Transactions on Intelligent Vehicles IEEE, 2023
- “Deep reinforcement learning-based drift parking control of automated vehicles” In Science China Technological Sciences 66.4 Springer, 2023, pp. 1152–1165
- “A probabilistic approach to mixed open-loop and closed-loop control, with application to extreme autonomous driving” In 2010 IEEE International Conference on Robotics and Automation, 2010, pp. 839–845 IEEE
- “Control barrier function based quadratic programs for safety critical systems” In IEEE Transactions on Automatic Control 62.8 IEEE, 2016, pp. 3861–3876
- Charles Dawson, Sicun Gao and Chuchu Fan “Safe control with learned certificates: A survey of neural lyapunov, barrier, and contraction methods for robotics and control” In IEEE Transactions on Robotics IEEE, 2023
- Tong Duy Son and Quan Nguyen “Safety-critical control for non-affine nonlinear systems with application on autonomous vehicle” In 2019 IEEE 58th Conference on Decision and Control (CDC), 2019, pp. 7623–7628 IEEE
- “Safety-critical control with nonaffine control inputs via a relaxed control barrier function for an autonomous vehicle” In IEEE Robotics and Automation Letters 7.2 IEEE, 2022, pp. 1944–1951
- Ian M Mitchell “The flexible, extensible and efficient toolbox of level set methods” In Journal of Scientific Computing 35 Springer, 2008, pp. 300–329
- “Refine: Reachability-based trajectory design using robust feedback linearization and zonotopes” In arXiv preprint arXiv:2211.11997, 2022
- Edo Jelavic, J Gonzales and Francesco Borrelli “Autonomous drift parking using a switched control strategy with onboard sensors” In IFAC-PapersOnLine 50.1 Elsevier, 2017, pp. 3714–3719
- Guinness World Records “Tightest Parallel Park - Guinness World Records” [accessed Feb 1, 2024], 2014 URL: https://youtu.be/IRXW7Ne1_88
- “Discrete control barrier functions for safety-critical control of discrete systems with application to bipedal robot navigation.” In Robotics: Science and Systems 13, 2017, pp. 1–10 Cambridge, MA, USA
- Ugo Rosolia, Andrew Singletary and Aaron D Ames “Unified multirate control: From low-level actuation to high-level planning” In IEEE Transactions on Automatic Control 67.12 IEEE, 2022, pp. 6627–6640
- “Probabilistic safe online learning with control barrier functions” In arXiv preprint arXiv:2208.10733, 2022
- “Scalable learning of safety guarantees for autonomous systems using Hamilton-Jacobi reachability” In 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 5914–5920 IEEE
- “Real-Time Robust Receding Horizon Planning Using Hamilton–Jacobi Reachability Analysis” In IEEE Transactions on Robotics 39.1 IEEE, 2022, pp. 90–109
- “Parameterized tube model predictive control” In IEEE Transactions on Automatic Control 57.11 IEEE, 2012, pp. 2746–2761
- “Robust MPC via min–max differential inequalities” In Automatica 77 Elsevier, 2017, pp. 311–321
- Kim Peter Wabersich and Melanie N Zeilinger “A predictive safety filter for learning-based control of constrained nonlinear dynamical systems” In Automatica 129 Elsevier, 2021, pp. 109597
- “Motion planning around obstacles with convex optimization” In Science robotics 8.84 American Association for the Advancement of Science, 2023, pp. eadf7843
- “Non-Euclidean Motion Planning with Graphs of Geodesically-Convex Sets” In arXiv preprint arXiv:2305.06341, 2023
- “Safety and liveness guarantees through reach-avoid reinforcement learning” In arXiv preprint arXiv:2112.12288, 2021
- “Solving Stabilize-Avoid Optimal Control via Epigraph Form and Deep Reinforcement Learning” In arXiv preprint arXiv:2305.14154, 2023
- “On Safety and Liveness Filtering Using Hamilton-Jacobi Reachability Analysis” In arXiv preprint arXiv:2312.15347, 2023
- David Fridovich-Keil, Jaime F Fisac and Claire J Tomlin “Safely probabilistically complete real-time planning and exploration in unknown environments” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 7470–7476 IEEE
- “Aggressive driving with model predictive path integral control” In 2016 IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 1433–1440 IEEE
- “Learning to be safe: Deep rl with a safety critic” In arXiv preprint arXiv:2010.14603, 2020
- “Probabilistic model predictive safety certification for learning-based control” In IEEE Transactions on Automatic Control 67.1 IEEE, 2021, pp. 176–188
- “Provably safe deep reinforcement learning for robotic manipulation in human environments” In 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 6344–6350 IEEE
- “Robust tracking with model mismatch for fast and safe planning: an SOS optimization approach” In Algorithmic Foundations of Robotics XIII: Proceedings of the 13th Workshop on the Algorithmic Foundations of Robotics 13, 2020, pp. 545–564 Springer
- Mo Chen, Sylvia Herbert and Claire J Tomlin “Fast reachable set approximations via state decoupling disturbances” In 2016 IEEE 55th Conference on Decision and Control (CDC), 2016, pp. 191–196 IEEE
- “Safe trajectory synthesis for autonomous driving in unforeseen environments” In Dynamic systems and control conference 58271, 2017, pp. V001T44A005 American Society of Mechanical Engineers
- Eugene Asarin, Thao Dang and Antoine Girard “Hybridization methods for the analysis of nonlinear systems” In Acta Informatica 43 Springer, 2007, pp. 451–476
- Thao Dang, Oded Maler and Romain Testylier “Accurate hybridization of nonlinear systems” In Proceedings of the 13th ACM international conference on Hybrid systems: computation and control, 2010, pp. 11–20
- “Approximate hybrid model predictive control for multi-contact push recovery in complex environments” In 2017 IEEE-RAS 17th international conference on humanoid robotics (Humanoids), 2017, pp. 31–38 IEEE
- “Stochastic predictive freeway ramp metering from signal temporal logic specifications” In 2017 American Control Conference (ACC), 2017, pp. 4884–4889 IEEE
- “Sampling-based polytopic trees for approximate optimal control of piecewise affine systems” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 7690–7696 IEEE
- “Mixed-integer formulations for optimal control of piecewise-affine systems” In Proceedings of the 22nd ACM International Conference on Hybrid Systems: Computation and Control, 2019, pp. 230–239
- Vassilis Sakizlis, Konstantinos I Kouramas and Efstratios N Pistikopoulos “Linear model predictive control via multiparametric programming” In Multi-Parametric Model-Based Control: Volume 2: Theory and Applications Citeseer, 2007, pp. 1–23
- Mato Baotic “Optimal control of piecewise affine systems: A multi-parametric approach”, 2005
- Komei Fukuda “Cddlib reference manual” In Report version 093a, McGill University, Montréal, Quebec, Canada, 2003
- Alexandre Maréchal, David Monniaux and Michaël Périn “Scalable minimizing-operators on polyhedra via parametric linear programming” In Static Analysis: 24th International Symposium, SAS 2017, New York, NY, USA, August 30–September 1, 2017, Proceedings 24, 2017, pp. 212–231 Springer
- Stephen P Boyd and Lieven Vandenberghe “Convex optimization” Cambridge university press, 2004
- Taeyoung Lee, Melvin Leok and N Harris McClamroch “Control of complex maneuvers for a quadrotor UAV using geometric methods on SE (3)” In arXiv preprint arXiv:1003.2005, 2010
- “Development of a quadrotor test bed—modelling, parameter identification, controller design and trajectory generation” In International Journal of Advanced Robotic Systems 12.2 SAGE Publications Sage UK: London, England, 2015, pp. 7
- E. Fiala “Lateral Forces at the Rolling Pneumatic Tire”, 1954 URL: https://books.google.com/books?id=B-wJngEACAAJ
- Tak Kit Lau “Learning autonomous drift parking from one demonstration” In 2011 IEEE International Conference on Robotics and Biomimetics, 2011, pp. 1456–1461 IEEE
- “Model learning for robot control: a survey” In Cognitive processing 12 Springer, 2011, pp. 319–340