Neuromorphic force-control in an industrial task: validating energy and latency benefits (2403.08928v3)
Abstract: As robots become smarter and more ubiquitous, optimizing the power consumption of intelligent compute becomes imperative towards ensuring the sustainability of technological advancements. Neuromorphic computing hardware makes use of biologically inspired neural architectures to achieve energy and latency improvements compared to conventional von Neumann computing architecture. Applying these benefits to robots has been demonstrated in several works in the field of neurorobotics, typically on relatively simple control tasks. Here, we introduce an example of neuromorphic computing applied to the real-world industrial task of object insertion. We trained a spiking neural network (SNN) to perform force-torque feedback control using a reinforcement learning approach in simulation. We then ported the SNN to the Intel neuromorphic research chip Loihi interfaced with a KUKA robotic arm. At inference time we show latency competitive with current CPU/GPU architectures, and one order of magnitude less energy usage in comparison to state-of-the-art low-energy edge-hardware. We offer this example as a proof of concept implementation of a neuromoprhic controller in real-world robotic setting, highlighting the benefits of neuromorphic hardware for the development of intelligent controllers for robots.
- Larry Greenemeier. Will ibm’s watson usher in a new era of cognitive computing? Scientific American, November 2013.
- Language models are few-shot learners. CoRR, abs/2005.14165, 2020.
- Vijay Balasubramanian. Brain power. Proceedings of the National Academy of Sciences, 118(32):e2107022118, 2021.
- 2022 roadmap on neuromorphic computing and engineering. Neuromorphic Computing and Engineering, 2(2):022501, may 2022.
- Advancing neuromorphic computing with loihi: A survey of results and outlook. Proceedings of the IEEE, 109(5):911–934, 2021.
- A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology, 117(4):500–544, 1952.
- Silicon-neuron design: A dynamical systems approach. IEEE Transactions on Circuits and Systems I: Regular Papers, 58:1034–1043, 2011.
- Neuromorphic computing hardware and neural architectures for robotics. Science Robotics, 7(67):eabl8419, 2022.
- Neon: Neuromorphic control for autonomous robotic navigation. In 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pages 136–142, 2017.
- Spiking neural network on neuromorphic hardware for energy-efficient unidimensional SLAM. CoRR, abs/1903.02504, 2019.
- A spiking central pattern generator for the control of a simulated lamprey robot running on spinnaker and loihi neuromorphic boards. Neuromorphic Computing and Engineering, 1, 08 2021.
- Event-driven vision and control for uavs on a neuromorphic chip. In 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021.
- Fully neuromorphic vision and control for autonomous drone flight. ArXiv Preprint, abs/2303.08778, 2023.
- A 3d-printed neuromorphic humanoid hand for grasping unknown objects. iScience, 25(4):104119, 2022.
- Embodied neuromorphic intelligence. Nature Communications, 13:1024, 02 2022.
- Connecting artificial brains to robots in a comprehensive simulation framework: The neurorobotics platform. Frontiers in Neurorobotics, 11, 2017.
- Data-driven artificial and spiking neural networks for inverse kinematics in neurorobotics. Patterns, 3:100391, 11 2021.
- Evolved neuromorphic radar-based altitude controller for an autonomous open-source blimp. CoRR, abs/2110.00646, 2021.
- Neuromorphic control of a simulated 7-dof arm using loihi. Neuromorphic Computing and Engineering, 3(1):014007, feb 2023.
- Generating event-based datasets for robotic applications using mujoco-esim. In Proceedings of the 2023 International Conference on Neuromorphic Systems, ICONS ’23, New York, NY, USA, 2023. Association for Computing Machinery.
- Neuromorphic eye-in-hand visual servoing. IEEE Access, 9:55853–55870, 2021.
- Neuromorphic vision based control for the precise positioning of robotic drilling systems. Robot. Comput.-Integr. Manuf., 79(C), feb 2023.
- Sigma-delta networks for robot arm control. In Proceedings of the 2023 Annual Neuro-Inspired Computational Elements Conference, NICE ’23, page 35–40, New York, NY, USA, 2023. Association for Computing Machinery.
- Towards neuromorphic control: A spiking neural network based pid controller for uav. In Robotics: Science and Systems 2020, 07 2020.
- Neuromorphic nef-based inverse kinematics and pid control. Frontiers in Neurorobotics, 15, 2021.
- Ed-biorob: A neuromorphic robotic arm with fpga-based infrastructure for bio-inspired spiking motor controllers. Frontiers in Neurorobotics, 14, 2020.
- An end-to-end spiking neural network platform for edge robotics: From event-cameras to central pattern generation. IEEE Transactions on Cognitive and Developmental Systems, 14:1092–1103, 2022.
- Adaptive control of a wheelchair mounted robotic arm with neuromorphically integrated velocity readings and online-learning. Frontiers in Neuroscience, 16, 2022.
- Neuromorphic computing for interactive robotics: A systematic review. IEEE Access, 10:122261–122279, 2022.
- H. Brussel and J. Simons. Adaptable compliance concept and its use for automatic assembly by active force feedback accommodations. Proceedings of the 9th International Symposium on Industrial Robots, pages 167–181, 01 1979.
- M. Nuttin and H. Brussel. Learning the peg-into-hole assembly operation with a connectionist reinforcement technique. Computers in Industry, 33:101–109, 08 1997.
- Force control for a rigid dual peg-in-hole assembly. Assembly Automation, 37:200–207, 04 2017.
- Active, uncalibrated visual servoing. In Proceedings of the 1994 IEEE International Conference on Robotics and Automation, pages 156–161 vol.1, 1994.
- Deep reinforcement learning for high precision assembly tasks, 2017.
- Variable compliance control for robotic peg-in-hole assembly: A deep-reinforcement-learning approach. Applied Sciences, 10(19):6923, oct 2020.
- Vision-enhanced peg-in-hole for automotive body parts using semantic image segmentation and object detection. Engineering Applications of Artificial Intelligence, 128:107486, 2024.
- Compare contact model-based control and contact model-free learning: A survey of robotic peg-in-hole assembly strategies. CoRR, abs/1904.05240, 2019.
- Deep drone acrobatics. CoRR, abs/2006.05768, 2020.
- Learning high-speed flight in the wild. Science Robotics, 6(59):eabg5810, 2021.
- Learning robust perceptive locomotion for quadrupedal robots in the wild. Science Robotics, 7(62):eabk2822, 2022.
- Champion-level drone racing using deep reinforcement learning. Nature, 620(7976):982–987, Aug 2023.
- Neurorobotics : A strategic pillar of the human brain project. pages 35–39. Science/AAAS Custom Publishing Office, 2016.
- Ros: an open-source robot operating system. In 2009 ICRA Workshop on Open Source Software, volume 3, 01 2009.
- N. Koenig and A. Howard. Design and use paradigms for gazebo, an open-source multi-robot simulator. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), volume 3, pages 2149–2154 vol.3, 2004.
- Camilo Amaya and Axel von Arnim. Neurorobotic reinforcement learning for domains with parametrical uncertainty. Frontiers in Neurorobotics, 17, 2023.
- Deep reinforcement learning with population-coded spiking neural network for continuous control, 2020.
- Efficient neuromorphic signal processing with loihi 2. In 2021 IEEE Workshop on Signal Processing Systems (SiPS), pages 254–259, 10 2021.
- Loihi: A neuromorphic manycore processor with on-chip learning. IEEE Micro, 38(1):82–99, 2018.
- Cartesian impedance control of redundant robots: recent results with the dlr-light-weight-arms. In 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422), volume 3, pages 3704–3709 vol.3, 2003.
- S. Macfarlane and E.A. Croft. Jerk-bounded manipulator trajectory planning: design for real-time applications. IEEE Transactions on Robotics and Automation, 19(1):42–52, 2003.
- Learning purely tactile in-hand manipulation with a torque-controlled hand, 04 2022.
- Lilian Weng. Domain randomization for sim2real transfer. lilianweng.github.io, 2019.
- Lopecs: A low-power edge computing system for real-time autonomous driving services. IEEE Access, 8:30467–30479, 2020.
- Hardware solutions for low-power smart edge computing. Journal of Low Power Electronics and Applications, 12(4), 2022.
- Deep reinforcement learning for robotic assembly of mixed deformable and rigid objects. pages 2062–2069, 10 2018.
- Intel. Intel advances neuromorphic with loihi 2, new lava software framework and new partners. (available at https://www.intel.com/content/www/us/en/newsroom/news/intel-unveils-neuromorphic-loihi-2-lava-software.html), 2022.
- Porting deep spiking q-networks to neuromorphic chip loihi. In International Conference on Neuromorphic Systems 2021, ICONS 2021, New York, NY, USA, 2021. Association for Computing Machinery.