Bezier-based Regression Feature Descriptor for Deformable Linear Objects (2312.16502v1)
Abstract: In this paper, a feature extraction approach for the deformable linear object is presented, which uses a Bezier curve to represent the original geometric shape. The proposed extraction strategy is combined with a parameterization technique, the goal is to compute the regression features from the visual-feedback RGB image, and finally obtain the efficient shape feature in the low-dimensional latent space. Existing works of literature often fail to capture the complex characteristics in a unified framework. They also struggle in scenarios where only local shape descriptors are used to guide the robot to complete the manipulation. To address these challenges, we propose a feature extraction technique using a parameterization approach to generate the regression features, which leverages the power of the Bezier curve and linear regression. The proposed extraction method effectively captures topological features and node characteristics, making it well-suited for the deformation object manipulation task. Large mount of simulations are conducted to evaluate the presented method. Our results demonstrate that the proposed method outperforms existing methods in terms of prediction accuracy, robustness, and computational efficiency. Furthermore, our approach enables the extraction of meaningful insights from the predicted links, thereby contributing to a better understanding of the shape of the deformable linear objects. Overall, this work represents a significant step forward in the use of Bezier curve for shape representation.
- L. Zaidi, B.-C. Bouzgarrou, L. Sabourin, and Y. Mezouar, “Interaction modeling in the grasping and manipulation of 3d deformable objects,” in 2015 International Conference on Advanced Robotics (ICAR). IEEE, 2015, pp. 504–509.
- E. Torgerson and F. W. Paul, “Vision-guided robotic fabric manipulation for apparel manufacturing,” IEEE Control Systems Magazine, vol. 8, no. 1, pp. 14–20, 1988.
- E. van Doleweerd, F. Altarriba Bertran, and M. Bruns, “Incorporating shape-changing food materials into everyday culinary practices: Guidelines informed by participatory sessions with chefs involving edible ph-responsive origami structures,” in Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2022, pp. 1–14.
- R. Kennaway, E. Coen, A. Green, and A. Bangham, “Generation of diverse biological forms through combinatorial interactions between tissue polarity and growth,” PLoS computational biology, vol. 7, no. 6, p. e1002071, 2011.
- L. Halt, F. Nagele, P. Tenbrock, and A. Pott, “Intuitive constraint-based robot programming for robotic assembly tasks,” in 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2018, pp. 520–526.
- J. Chen, Y.-Q. Chen, Y.-J. Shi, S.-Q. Ding, et al., “Vx-765 reduces neuroinflammation after spinal cord injury in mice,” Neural Regeneration Research, vol. 16, no. 9, p. 1836, 2021.
- C. Yang, P. Zhou, and J. Qi, “Integrating visual foundation models for enhanced robot manipulation and motion planning: A layered approach,” arXiv preprint arXiv:2309.11244, 2023.
- J. Qi, G. Ma, P. Zhou, H. Zhang, et al., “Towards latent space based manipulation of elastic rods using autoencoder models and robust centerline extractions,” Advanced Robotics, vol. 36, no. 3, pp. 101–115, 2022.
- Hou, Y. CheongSahari, K. S. MohamedHow, and D. N. Tze, “A review on modeling of the flexible deformable object for dexterous robotic manipulation,” Annals of the American Thoracic Society, vol. 16, no. 3, 2019.
- Foresti, Luca, Gian, Pellegrino, and A. Felice, “Automatic visual recognition of deformable objects for grasping and manipulation.” IEEE Transactions on Systems, Man Cybernetics: Part C - Applications Reviews, 2004.
- G. Ma, J. Qi, Y. Lv, and H. Zeng, “Active manipulation of elastic rods using optimization-based shape perception and sensorimotor model approximation,” in 2022 41st Chinese Control Conference (CCC). IEEE, 2022, pp. 3780–3785.
- T. A. Pastva, “Bezier curve fitting,” Ph.D. dissertation, Monterey, California. Naval Postgraduate School, 1998.
- P.-Y. Gousenbourger, E. Massart, and P.-A. Absil, “Data fitting on manifolds with composite bézier-like curves and blended cubic splines,” Journal of Mathematical Imaging and Vision, vol. 61, no. 5, pp. 645–671, 2019.
- D. D’Angella, S. Kollmannsberger, E. Rank, and A. Reali, “Multi-level bézier extraction for hierarchical local refinement of isogeometric analysis,” Computer Methods in Applied Mechanics and Engineering, vol. 328, pp. 147–174, 2018.
- S. Bansal and P. Nagar, “Emotion recognition from facial expression based on bezier curve,” Int J Adv Inf Technol, vol. 5, no. 4, p. 5, 2015.
- A. Gálvez, A. Cobo, J. Puig-Pey, and A. Iglesias, “Particle swarm optimization for bézier surface reconstruction,” in Computational Science–ICCS 2008: 8th International Conference, Kraków, Poland, June 23-25, 2008, Proceedings, Part II 8. Springer, 2008, pp. 116–125.
- D. A. Nugroho, S. Rizal, and D.-S. Kim, “Reconstruct unrecoverable data in real-time networks using bézier curve,” IET Communications, vol. 9, no. 5, pp. 596–602, 2015.
- M. Perez-Liva, J. M. Udías, J. Camacho, E. Merčep, et al., “Speed of sound ultrasound transmission tomography image reconstruction based on bézier curves,” Ultrasonics, vol. 103, p. 106097, 2020.
- Z. Li, L.-z. Ma, W.-z. Tan, and M.-x. Zhao, “Reconstruction from contour lines based on bi-cubic bézier spline surface,” Journal of Zhejiang University-SCIENCE A, vol. 7, no. 7, pp. 1241–1246, 2006.
- L. Hayen, N. Severijns, K. Bodek, D. Rozpedzik, and X. Mougeot, “High precision analytical description of the allowed β𝛽\betaitalic_β spectrum shape,” Reviews of Modern Physics, vol. 90, no. 1, p. 015008, 2018.
- D. V. Vranic and D. Saupe, “Description of 3d-shape using a complex function on the sphere,” in Proceedings. IEEE International Conference on Multimedia and Expo, vol. 1. IEEE, 2002, pp. 177–180.
- C. Ronse and B. Macq, “Morphological shape and region description,” Signal Processing, vol. 25, no. 1, pp. 91–105, 1991.
- A. Shademan and F. Janabi-Sharifi, “Using scale-invariant feature points in visual servoing,” in Machine Vision and its Optomechatronic Applications, vol. 5603. SPIE, 2004, pp. 63–70.
- A. Mcfadyen, M. Jabeur, and P. Corke, “Image-based visual servoing with unknown point feature correspondence,” IEEE Robotics and Automation Letters, vol. 2, no. 2, pp. 601–607, 2016.
- J. Wang and H. Cho, “Micropeg and hole alignment using image moments based visual servoing method,” IEEE Transactions on Industrial Electronics, vol. 55, no. 3, pp. 1286–1294, 2008.
- B.-S. Lu, T.-I. Chen, H.-Y. Lee, and W. H. Hsu, “Cfvs: Coarse-to-fine visual servoing for 6-dof object-agnostic peg-in-hole assembly,” in 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023, pp. 12 402–12 408.
- H. Liu, W. Zhu, H. Dong, and Y. Ke, “Hybrid visual servoing for rivet-in-hole insertion based on super-twisting sliding mode control,” International Journal of Control, Automation and Systems, vol. 18, pp. 2145–2156, 2020.
- P. Vicente, L. Jamone, and A. Bernardino, “Towards markerless visual servoing of grasping tasks for humanoid robots,” in 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017, pp. 3811–3816.
- B. Luo, H. Chen, F. Quan, S. Zhang, and Y. Liu, “Natural feature-based visual servoing for grasping target with an aerial manipulator,” Journal of Bionic Engineering, vol. 17, pp. 215–228, 2020.
- P. Ardón, M. Dragone, and M. S. Erden, “Reaching and grasping of objects by humanoid robots through visual servoing,” in Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part II 11. Springer, 2018, pp. 353–365.
- Y.-C. Peng, D. Jivani, R. J. Radke, and J. Wen, “Comparing position-and image-based visual servoing for robotic assembly of large structures,” in 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE). IEEE, 2020, pp. 1608–1613.
- H. Zeng, Y. Lyu, J. Qi, S. Zou, et al., “Adaptive finite-time model estimation and control for manipulator visual servoing using sliding mode control and neural networks,” Advanced Robotics, vol. 37, no. 9, pp. 576–590, 2023.
- M. Nuriyev, “A simulation for determining the relation between position of the center mass and the impact of the accident’s fatality on the car driver.” 2007.
- S. Zou, Y. Lyu, J. Qi, G. Ma, and Y. Guo, “A deep neural network approach for accurate 3d shape estimation of soft manipulator with vision correction,” Sensors and Actuators A: Physical, vol. 344, p. 113692, 2022.
- M. Marey and F. Chaumette, “Analysis of classical and new visual servoing control laws,” in 2008 IEEE International Conference on Robotics and Automation. IEEE, 2008, pp. 3244–3249.
- H. Zeng, Z. Lu, Y. Lv, and J. Qi, “Adaptive neural network-based visual servoing with integral sliding mode control for manipulator,” in 2022 41st Chinese Control Conference (CCC). IEEE, 2022, pp. 3567–3572.
- J. LaPorte, “Rigid designators for properties,” Philosophical Studies, vol. 130, pp. 321–336, 2006.
- S. Samangooei, B. Guo, and M. S. Nixon, “The use of semantic human description as a soft biometric,” in 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems. IEEE, 2008, pp. 1–7.
- B. Tawbe and A.-M. Cretu, “Data-driven representation of soft deformable objects based on force-torque data and 3d vision measurements,” in Proceedings, vol. 1, no. 2. MDPI, 2016, p. 22.
- W. D. Stromberg and T. G. Farr, “A fourier-based textural feature extraction procedure,” IEEE Transactions on Geoscience and Remote Sensing, no. 5, pp. 722–731, 1986.