PONG: Probabilistic Object Normals for Grasping via Analytic Bounds on Force Closure Probability (2309.16930v1)
Abstract: Classical approaches to grasp planning are deterministic, requiring perfect knowledge of an object's pose and geometry. In response, data-driven approaches have emerged that plan grasps entirely from sensory data. While these data-driven methods have excelled in generating parallel-jaw and power grasps, their application to precision grasps (those using the fingertips of a dexterous hand, e.g, for tool use) remains limited. Precision grasping poses a unique challenge due to its sensitivity to object geometry, which allows small uncertainties in the object's shape and pose to cause an otherwise robust grasp to fail. In response to these challenges, we introduce Probabilistic Object Normals for Grasping (PONG), a novel, analytic approach for calculating a conservative estimate of force closure probability in the case when contact locations are known but surface normals are uncertain. We then present a practical application where we use PONG as a grasp metric for generating robust grasps both in simulation and real-world hardware experiments. Our results demonstrate that maximizing PONG efficiently produces robust grasps, even for challenging object geometries, and that it can serve as a well-calibrated, uncertainty-aware metric of grasp quality.
- Grasp quality measures: review and performance. Autonomous Robots, 38:65 – 88, 2014.
- Z. Li and S.S. Sastry. Task-oriented optimal grasping by multifingered robot hands. IEEE Journal on Robotics and Automation, 4(1):32–44, 1988.
- Leveraging big data for grasp planning. In 2015 IEEE International Conference on Robotics and Automation (ICRA), pages 4304–4311, 2015.
- Deep Dexterous Grasping of Novel Objects from a Single View. Int. J. Humanoid Robotics, 19:2250011:1–2250011:30, 2019.
- UniGrasp: Learning a Unified Model to Grasp with N-Fingered Robotic Hands. ArXiv, abs/1910.10900, 2019.
- Pose error robust grasping from contact wrench space metrics. In 2012 IEEE International Conference on Robotics and Automation, pages 557–562, 2012.
- Gaussian process implicit surfaces for shape estimation and grasping. In 2011 IEEE International Conference on Robotics and Automation, pages 2845–2850, 2011.
- GP-GPIS-OPT: Grasp planning with shape uncertainty using Gaussian process implicit surfaces and Sequential Convex Programming. In 2015 IEEE International Conference on Robotics and Automation (ICRA), pages 4919–4926, 2015.
- Simultaneous tactile exploration and grasp refinement for unknown objects. IEEE Robotics and Automation Letters, PP, 02 2021.
- Discovering stable robot grasps for unknown objects in presence of uncertainty using bayesian models. In Towards Autonomous Robotic Systems: 22nd Annual Conference, TAROS 2021, Lincoln, UK, September 8–10, 2021, Proceedings, page 46–55, Berlin, Heidelberg, 2021. Springer-Verlag.
- Dexterous grasping under shape uncertainty. Robotics and Autonomous Systems, 75:352–364, 2016.
- Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics. ArXiv, abs/1703.09312, 2017.
- Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network. In International Symposium of Robotics Research, 2018.
- Multifingered Grasp Planning via Inference in Deep Neural Networks: Outperforming Sampling by Learning Differentiable Models. IEEE Robotics and Automation Magazine, 27(2):55–65, 2020.
- Synthesis and Optimization of Force Closure Grasps via Sequential Semidefinite Programming. In International Symposium of Robotics Research, 2015.
- Deep Differentiable Grasp Planner for High-DOF Grippers. ArXiv, abs/2002.01530, 2020.
- Synthesizing Diverse and Physically Stable Grasps With Arbitrary Hand Structures Using Differentiable Force Closure Estimator. IEEE Robotics and Automation Letters, 7:470–477, 2021.
- DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulation. ArXiv, abs/2210.02697, 2022.
- Learning Diverse and Physically Feasible Dexterous Grasps with Generative Model and Bilevel Optimization. ArXiv, abs/2207.00195, 2022.
- FRoGGeR: Fast Robust Grasp Generation via the Min-Weight Metric. ArXiv, abs/2302.13687, 2023.
- A mathematical introduction to robotic manipulation. CRC press, 1994.
- The Mechanics of Robot Grasping. Cambridge University Press, 2019.
- 2d voronoi coverage control with gaussian density functions by line integration. SICE Journal of Control, Measurement, and System Integration, 10(2):110–116, 2017.
- B. O’Neill. Elementary Differential Geometry, Revised 2nd Edition. Elsevier Science, 2006.
- Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. NeurIPS, 2021.
- A simple and efficient approach for 3D mesh approximate convex decomposition. In 2009 16th IEEE International Conference on Image Processing (ICIP), pages 3501–3504, 2009.
- The Pinocchio C++ library – A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives. In International Symposium on System Integration (SII), 2019.
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. CoRR, abs/2003.08934, 2020.
- Nerfstudio: A modular framework for neural radiance field development. In ACM SIGGRAPH 2023 Conference Proceedings, SIGGRAPH ’23, 2023.
- Russ Tedrake and the Drake Development Team. Drake: Model-based design and verification for robotics, 2019.