Learning deformable linear object dynamics from a single trajectory
Abstract: The manipulation of deformable linear objects (DLOs) via model-based control requires an accurate and computationally efficient dynamics model. Yet, data-driven DLO dynamics models require large training data sets while their predictions often do not generalize, whereas physics-based models rely on good approximations of physical phenomena and often lack accuracy. To address these challenges, we propose a physics-informed neural ODE capable of predicting agile movements with significantly less data and hyper-parameter tuning. In particular, we model DLOs as serial chains of rigid bodies interconnected by passive elastic joints in which interaction forces are predicted by neural networks. The proposed model accurately predicts the motion of an robotically-actuated aluminium rod and an elastic foam cylinder after being trained on only thirty seconds of data. The project code and data are available at: \url{https://tinyurl.com/neuralprba}
- Modeling of deformable objects for robotic manipulation: A tutorial and review. Frontiers in Robotics and AI, 7:82, 2020.
- Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey. The International Journal of Robotics Research, 37(7):688–716, 2018.
- Self-supervised learning of state estimation for manipulating deformable linear objects. IEEE Robotics and Automation Letters, 5(2):2372–2379, 2020.
- Learning to propagate interaction effects for modeling deformable linear objects dynamics. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 1950–1957. IEEE, 2021.
- Global model learning for large deformation control of elastic deformable linear objects: An efficient and adaptive approach. IEEE Transactions on Robotics, 39(1):417–436, 2022.
- O. A. Bauchau. Flexible multibody dynamics, volume 176. Springer, 2011.
- Dynamics of flexible multibody systems: rigid finite element method. Springer Science & Business Media, 2007.
- Pseudo-rigid body networks: learning interpretable deformable object dynamics from partial observations. arXiv preprint arXiv:2307.07975, 2023.
- Physically based real-time interactive assembly simulation of cable harness. Journal of Manufacturing Systems, 43:385–399, 2017.
- Soft robots modeling: A structured overview. IEEE Transactions on Robotics, 2023.
- Interaction networks for learning about objects, relations and physics. Advances in neural information processing systems, 29, 2016.
- Tracking fast trajectories with a deformable object using a learned model. In 2022 International Conference on Robotics and Automation (ICRA), pages 1351–1357, 2022.
- Propagation networks for model-based control under partial observation. In ICRA, 2019.
- Modeling and parameter estimation of robot manipulators using extended flexible joint models. Journal of Dynamic Systems, Measurement, and Control, 136(3):031005, 2014.
- Discrete elastic rods. In ACM SIGGRAPH, pages 1–12. 2008.
- Recognition models to learn dynamics from partial observations with neural odes. Transactions on Machine Learning Research, 2022.
- Neural ordinary differential equations. Advances in neural information processing systems, 31, 2018.
- Continuous-time identification of dynamic state-space models by deep subspace encoding. In The Eleventh International Conference on Learning Representations, 2023.
- R. Featherstone. Rigid body dynamics algorithms. 2014.
- Model predictive control: theory, computation, and design, volume 2. Nob Hill Publishing Madison, WI, 2017.
- CasADi – A software framework for nonlinear optimization and optimal control. Mathematical Programming Computation, 11(1):1–36, 2019.
- Fast integrators with sensitivity propagation for use in casadi. In 2023 European Control Conference (ECC), pages 1–6. IEEE, 2023.
- Mujoco: A physics engine for model-based control. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 5026–5033. IEEE, 2012.
- JAX: composable transformations of Python+NumPy programs, 2018. URL http://github.com/google/jax.
- P. Kidger and C. Garcia. Equinox: neural networks in JAX via callable PyTrees and filtered transformations. Differentiable Programming workshop at Neural Information Processing Systems, 2021.
- A. Kværnø. Singly diagonally implicit runge–kutta methods with an explicit first stage. BIT Numerical Mathematics, 44(3):489–502, 2004.
- P. Kidger. On Neural Differential Equations. PhD thesis, University of Oxford, 2021.
- I. Loshchilov and F. Hutter. Decoupled weight decay regularization. In International Conference on Learning Representations, 2019.
- Linear matrix inequalities for physically consistent inertial parameter identification: A statistical perspective on the mass distribution. IEEE Robotics and Automation Letters, 3(1):60–67, 2017.
- Encoding physical constraints in differentiable newton-euler algorithm. In Learning for Dynamics and Control, pages 804–813. PMLR, 2020.
- Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural networks, 107:3–11, 2018.
- Differentiable convex optimization layers. Advances in neural information processing systems, 32, 2019.
- W. J. Book. Recursive lagrangian dynamics of flexible manipulator arms. The International Journal of Robotics Research, 3(3):87–101, 1984.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.