Euclidean Equivariant Models for Generative Graphical Inverse Kinematics (2307.01902v1)
Abstract: Quickly and reliably finding accurate inverse kinematics (IK) solutions remains a challenging problem for robotic manipulation. Existing numerical solvers typically produce a single solution only and rely on local search techniques to minimize a highly nonconvex objective function. Recently, learning-based approaches that approximate the entire feasible set of solutions have shown promise as a means to generate multiple fast and accurate IK results in parallel. However, existing learning-based techniques have a significant drawback: each robot of interest requires a specialized model that must be trained from scratch. To address this shortcoming, we investigate a novel distance-geometric robot representation coupled with a graph structure that allows us to leverage the flexibility of graph neural networks (GNNs). We use this approach to train a generative graphical inverse kinematics solver (GGIK) that is able to produce a large number of diverse solutions in parallel while also generalizing well -- a single learned model can be used to produce IK solutions for a variety of different robots. The graphical formulation elegantly exposes the symmetry and Euclidean equivariance of the IK problem that stems from the spatial nature of robot manipulators. We exploit this symmetry by encoding it into the architecture of our learned model, yielding a flexible solver that is able to produce sets of IK solutions for multiple robots.
- IKFlow: Generating diverse inverse kinematics solutions. IEEE Intl. Conf. Robotics and Automation (ICRA), 7(3):7177–7184, 2022.
- Inverse Kinematics Techniques in Computer Graphics: A Survey. Computer Graphics Forum, 37(6):35–58, September 2018.
- TRAC-IK: An open-source library for improved solving of generic inverse kinematics. In 15th Intl. Conf. Humanoid Robots (Humanoids), pages 928–935, 2015.
- Neural inverse kinematic. In Proc. 39th Intl. Conf. Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 1787–1797, 2022.
- Convex iteration for distance-geometric inverse kinematics. IEEE Robot. Autom. Lett., 7(2):1952–1959, 2022.
- Neural message passing for quantum chemistry. In Proc. 34th Intl. Conf. Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 1263–1272, 2017.
- Inductive representation learning on large graphs. Advances in Neural Information Processing Systems (NeurIPS), 30, 2017.
- Selective inverse kinematics: A novel approach to finding multiple solutions fast for high-DoF robotic. arXiv preprint arXiv:2202.07869 [cs.RO], 2022.
- Auto-encoding variational Bayes. In Yoshua Bengio and Yann LeCun, editors, Intl. Conf. Learning Representations (ICLR), 2014.
- Semi-Supervised Classification with Graph Convolutional Networks. In Int. Conf. Learning Representations, 2017.
- Learning constrained distributions of robot configurations with generative adversarial network. IEEE Robot. Autom. Lett., 6(2):4233–4240, 2021.
- Euclidean Distance Geometry and Applications. SIAM Rev., 56(1):3–69, January 2014.
- Riemannian optimization for distance-geometric inverse kinematics. IEEE Trans. Robotics, 38(3):1703–1722, 2022.
- A branch-and-prune solver for distance constraints. IEEE Trans. Robotics, 21:176–187, April 2005.
- Learning inverse kinematics and dynamics of a robotic manipulator using generative adversarial networks. Robotics and Autonomous Systems, 124:103386, 2020.
- E (n) equivariant graph neural networks. In Intl. Conf. Machine Learning (ICML), pages 9323–9332, 2021.
- Learning structured output representation using deep conditional generative models. In Advances in Neural Information Processing Systems, volume 28, 2015.
- Graph attention networks. In Intl. Conf. Learning Representations (ICLR), 2018.
- Comparison of distal teacher learning with numerical and analytical methods to solve inverse kinematics for rigid-body mechanisms. arXiv preprint arXiv:2003.00225 [cs.RO], 2020.