Guiding Soft Robots with Motor-Imagery Brain Signals and Impedance Control (2401.13441v1)
Abstract: Integrating Brain-Machine Interfaces into non-clinical applications like robot motion control remains difficult - despite remarkable advancements in clinical settings. Specifically, EEG-based motor imagery systems are still error-prone, posing safety risks when rigid robots operate near humans. This work presents an alternative pathway towards safe and effective operation by combining wearable EEG with physically embodied safety in soft robots. We introduce and test a pipeline that allows a user to move a soft robot's end effector in real time via brain waves that are measured by as few as three EEG channels. A robust motor imagery algorithm interprets the user's intentions to move the position of a virtual attractor to which the end effector is attracted, thanks to a new Cartesian impedance controller. We specifically focus here on planar soft robot-based architected metamaterials, which require the development of a novel control architecture to deal with the peculiar nonlinearities - e.g., non-affinity in control. We preliminarily but quantitatively evaluate the approach on the task of setpoint regulation. We observe that the user reaches the proximity of the setpoint in 66% of steps and that for successful steps, the average response time is 21.5s. We also demonstrate the execution of simple real-world tasks involving interaction with the environment, which would be extremely hard to perform if it were not for the robot's softness.
- S. Liu, L. Wang, and R. X. Gao, “Cognitive neuroscience and robotics: Advancements and future research directions,” Robotics and Computer-Integrated Manufacturing, vol. 85, p. 102610, 2024.
- S. M. Coyle, T. E. Ward, and C. M. Markham, “Brain–computer interface using a simplified functional near-infrared spectroscopy system,” Journal of neural engineering, vol. 4, no. 3, p. 219, 2007.
- K. Lee, D. Liu, et al., “A brain-controlled exoskeleton with cascaded event-related desynchronization classifiers,” Robotics and Autonomous Systems, vol. 90, pp. 15–23, 2017.
- J. Van Erp, F. Lotte, and M. Tangermann, “Brain-computer interfaces: beyond medical applications,” Computer, vol. 45, no. 4, pp. 26–34, 2012.
- M. A. Khan, R. Das, et al., “Review on motor imagery based bci systems for upper limb post-stroke neurorehabilitation: From designing to application,” Computers in biology and medicine, vol. 123, p. 103843, 2020.
- L. Schiatti, J. Tessadori, et al., “Soft brain-machine interfaces for assistive robotics: A novel control approach,” in 2017 International Conference on Rehabilitation Robotics (ICORR). IEEE, 2017, pp. 863–869.
- S. Aldini, A. Akella, et al., “Effect of mechanical resistance on cognitive conflict in physical human-robot collaboration,” in 2019 international conference on robotics and automation (ICRA). IEEE, 2019, pp. 6137–6143.
- R. Zhang, S. Lee, et al., “Noir: Neural signal operated intelligent robots for everyday activities,” arXiv preprint arXiv:2311.01454, 2023.
- P. Arpaia, D. Coyle, et al., “Non-immersive versus immersive extended reality for motor imagery neurofeedback within a brain-computer interfaces,” in International Conference on Extended Reality. Springer, 2022, pp. 407–419.
- D. Rus and M. T. Tolley, “Design, fabrication and control of soft robots,” Nature, vol. 521, no. 7553, pp. 467–475, 2015.
- C. Della Santina, M. G. Catalano, et al., “Soft robots,” Encyclopedia of Robotics, vol. 489, 2020.
- J. Zhang, B. Wang, et al., “An eeg/emg/eog-based multimodal human-machine interface to real-time control of a soft robot hand,” Frontiers in neurorobotics, vol. 13, p. 7, 2019.
- N. Tacca, J. Nassour, et al., “Neuro-cognitive assessment of intentional control methods for a soft elbow exosuit using error-related potentials,” Journal of NeuroEngineering and Rehabilitation, vol. 19, no. 1, p. 124, 2022.
- C. Della Santina, M. Bianchi, et al., “Controlling soft robots: balancing feedback and feedforward elements,” IEEE Robotics & Automation Magazine, vol. 24, no. 3, pp. 75–83, 2017.
- M. Stölzle, L. Chin, et al., “Modelling handed shearing auxetics: Selective piecewise constant strain kinematics and dynamic simulation,” in 2023 IEEE International Conference on Soft Robotics (RoboSoft). IEEE, 2023, pp. 1–8.
- M. Stölzle, D. Rus, and C. D. Santina, “An experimental study of model-based control for planar handed shearing auxetics robots,” in Experimental Robotics: The 18th International Symposium. Springer, 2023.
- M. Lotze and U. Halsband, “Motor imagery,” Journal of Physiology-paris, vol. 99, no. 4-6, pp. 386–395, 2006.
- I. Good, T. Brown-Moore, et al., “Expanding the design space for electrically-driven soft robots through handed shearing auxetics,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 10 951–10 957.
- C. Della Santina, L. Pallottino, et al., “Exact task execution in highly under-actuated soft limbs: an operational space based approach,” IEEE Robotics and Automation Letters, vol. 4, no. 3, pp. 2508–2515, 2019.
- C. Della Santina, R. K. Katzschmann, et al., “Model-based dynamic feedback control of a planar soft robot: trajectory tracking and interaction with the environment,” The International Journal of Robotics Research, vol. 39, no. 4, pp. 490–513, 2020.
- C. Della Santina, C. Duriez, and D. Rus, “Model-based control of soft robots: A survey of the state of the art and open challenges,” IEEE Control Systems Magazine, vol. 43, no. 3, pp. 30–65, 2023.
- M. Blondel, Q. Berthet, et al., “Efficient and modular implicit differentiation,” arXiv preprint arXiv:2105.15183, 2021.
- F. Lotte, “A tutorial on eeg signal-processing techniques for mental-state recognition in brain–computer interfaces,” Guide to brain-computer music interfacing, pp. 133–161, 2014.
- A. Roc, L. Pillette, et al., “A review of user training methods in brain computer interfaces based on mental tasks,” Journal of Neural Engineering, vol. 18, no. 1, p. 011002, 2021.
- G. Pfurtscheller and F. L. Da Silva, “Event-related eeg/meg synchronization and desynchronization: basic principles,” Clinical neurophysiology, vol. 110, no. 11, pp. 1842–1857, 1999.