Papers
Topics
Authors
Recent
Search
2000 character limit reached

D-LGP: Dynamic Logic-Geometric Program for Reactive Task and Motion Planning

Published 5 Dec 2023 in cs.RO | (2312.02731v3)

Abstract: Many real-world sequential manipulation tasks involve a combination of discrete symbolic search and continuous motion planning, collectively known as combined task and motion planning (TAMP). However, prevailing methods often struggle with the computational burden and intricate combinatorial challenges, limiting their applications for online replanning in the real world. To address this, we propose Dynamic Logic-Geometric Program (D-LGP), a novel approach integrating Dynamic Tree Search and global optimization for efficient hybrid planning. Through empirical evaluation on three benchmarks, we demonstrate the efficacy of our approach, showcasing superior performance in comparison to state-of-the-art techniques. We validate our approach through simulation and demonstrate its reactive capability to cope with online uncertainty and external disturbances in the real world. Project webpage: https://sites.google.com/view/dyn-lgp.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (21)
  1. C. R. Garrett, R. Chitnis, R. Holladay, B. Kim, T. Silver, L. P. Kaelbling, and T. Lozano-Pérez, “Integrated task and motion planning,” Annual review of control, robotics, and autonomous systems, vol. 4, pp. 265–293, 2021.
  2. A. Razmjoo, T. S. Lembono, and S. Calinon, “Optimal control combining emulation and imitation to acquire physical assistance skills,” in 2021 20th International Conference on Advanced Robotics (ICAR).   IEEE, 2021, pp. 338–343.
  3. M. Toussaint and M. Lopes, “Multi-bound tree search for logic-geometric programming in cooperative manipulation domains,” in Proc. IEEE Intl Conf. on Robotics and Automation (ICRA), 2017, pp. 4044–4051.
  4. C. V. Braun, J. Ortiz-Haro, M. Toussaint, and O. S. Oguz, “Rhh-lgp: Receding horizon and heuristics-based logic-geometric programming for task and motion planning,” in Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS), 2022, pp. 13 761–13 768.
  5. M. Toussaint, “Logic-geometric programming: an optimization-based approach to combined task and motion planning,” in Proceedings of the 24th International Conference on Artificial Intelligence, 2015, pp. 1930–1936.
  6. R. Bellman, “Dynamic programming,” Science, vol. 153, no. 3731, pp. 34–37, 1966.
  7. S. Cambon, R. Alami, and F. Gravot, “A hybrid approach to intricate motion, manipulation and task planning,” Intl Journal of Robotics Research, vol. 28, no. 1, pp. 104–126, 2009.
  8. E. Plaku and G. D. Hager, “Sampling-based motion and symbolic action planning with geometric and differential constraints,” in Proc. IEEE Intl Conf. on Robotics and Automation (ICRA), 2010, pp. 5002–5008.
  9. C. R. Garrett, T. Lozano-Pérez, and L. P. Kaelbling, “Pddlstream: Integrating symbolic planners and blackbox samplers via optimistic adaptive planning,” in Proceedings of the International Conference on Automated Planning and Scheduling, vol. 30, 2020, pp. 440–448.
  10. C. R. Garrett, T. Lozano-Perez, and L. P. Kaelbling, “Ffrob: Leveraging symbolic planning for efficient task and motion planning,” Intl Journal of Robotics Research, vol. 37, no. 1, pp. 104–136, 2018.
  11. C. Quintero-Pena, Z. Kingston, T. Pan, R. Shome, A. Kyrillidis, and L. E. Kavraki, “Optimal grasps and placements for task and motion planning in clutter,” in Proc. IEEE Intl Conf. on Robotics and Automation (ICRA), 2023, pp. 3707–3713.
  12. N. T. Dantam, Z. K. Kingston, S. Chaudhuri, and L. E. Kavraki, “An incremental constraint-based framework for task and motion planning,” Intl Journal of Robotics Research, vol. 37, no. 10, pp. 1134–1151, 2018.
  13. S. LaValle, “Rapidly-exploring random trees: A new tool for path planning,” Research Report 9811, 1998.
  14. V. N. Hartmann, O. S. Oguz, D. Driess, M. Toussaint, and A. Menges, “Robust task and motion planning for long-horizon architectural construction planning,” in Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS), 2020, pp. 6886–6893.
  15. J. Ortiz-Haro, E. Karpas, M. Toussaint, and M. Katz, “Conflict-directed diverse planning for logic-geometric programming,” in Proceedings of the International Conference on Automated Planning and Scheduling, vol. 32, 2022, pp. 279–287.
  16. Gurobi Optimization, Inc., “Gurobi optimizer reference manual,” 2014. [Online]. Available: http://www.gurobi.com/
  17. L. Blackmore, M. Ono, and B. C. Williams, “Chance-constrained optimal path planning with obstacles,” IEEE Transactions on Robotics, vol. 27, no. 6, pp. 1080–1094, 2011.
  18. T. Migimatsu and J. Bohg, “Object-centric task and motion planning in dynamic environments,” IEEE Robotics and Automation Letters (RA-L), vol. 5, no. 2, pp. 844–851, 2020.
  19. J. A. Andersson, J. Gillis, G. Horn, J. B. Rawlings, and M. Diehl, “Casadi: a software framework for nonlinear optimization and optimal control,” Mathematical Programming Computation, vol. 11, no. 1, pp. 1–36, 2019.
  20. P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, et al., “Scipy 1.0: fundamental algorithms for scientific computing in python,” Nature methods, vol. 17, no. 3, pp. 261–272, 2020.
  21. R. Deits and R. Tedrake, “Computing large convex regions of obstacle-free space through semidefinite programming,” in Algorithmic Foundations of Robotics XI: Selected Contributions of the Eleventh International Workshop on the Algorithmic Foundations of Robotics.   Springer, 2015, pp. 109–124.
Citations (3)

Summary

  • The paper introduces a novel D-LGP algorithm combining dynamic tree search with quadratic optimization to derive feasible and globally optimal task and motion plans.
  • It employs mixed-integer quadratic programming and receding-horizon strategies to address the combinatorial and continuous challenges of TAMP.
  • Empirical and real-world experiments demonstrate that D-LGP outperforms existing methods, offering enhanced efficiency and adaptability in dynamic environments.

Introduction

Robots are becoming increasingly essential in various tasks that involve both planning and physical manipulation. The effectiveness of these robotic systems in such tasks depends heavily on their ability to handle complex planning that involves both high-level decision-making and low-level control to execute actions. This intertwines two areas in robotics known as Task and Motion Planning (TAMP). However, TAMP is challenging due to the need to consider both the symbolic, discrete decisions and the continuous, geometric motions, which can result in significant computational complexities.

Dynamic Logic-Geometric Program (D-LGP)

To enhance the efficiency of TAMP, a method called Dynamic Logic-Geometric Program (D-LGP) has been presented. It combines a novel approach of Dynamic Tree Search (DTS) with global optimization techniques. The DTS offers a backpropagation mechanism to identify action skeletons, while quadratic optimization globally solves the non-convex, continuous space of motion planning. This combined approach aims to address the difficulties associated with finding feasible task sequences out of a large number of combinatorial choices and also producing a globally optimal motion plan in a substantially reduced computational time.

Feasibility and Optimality

The D-LGP algorithm provides a hierarchical framework, which enables the effective communication of feasible task sequences from the symbolic level to the geometric level. By utilizing mixed-integer quadratic programming, it can confidently derive globally optimal solutions or determine infeasibility in complex TAMP problems. Additionally, the algorithm's capability to rapidly produce solutions allows for its use in a receding-horizon planning fashion, accommodating real-world uncertainties and disturbances during robot manipulation tasks.

Empirical Evaluation and Robot Experiments

Empirical evaluations of the D-LGP approach were conducted on several benchmark problems, where robots were tasked with manipulating objects in sequences with long planning horizons. The results confirmed that D-LGP outperformed state-of-the-art comparative techniques with superior efficiency and optimality. Furthermore, real-world experiments with a robot demonstrated D-LGP's adaptability to dynamic environments, successfully accounting for unexpected changes during task execution.

Conclusion

D-LGP offers an innovative solution to the intricacies of TAMP for real-world robotic manipulation. It successfully bridges the gap between task-level planning and motion-level planning, producing highly efficient and reliable outcomes. The D-LGP framework showcases the potential for advanced robotic systems to operate effectively in complex, dynamic environments by intelligently planning and executing tasks with an awareness of both their symbolic and geometric implications.

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.