Robot Motion Prediction by Channel State Information (2307.03829v1)
Abstract: Autonomous robotic systems have gained a lot of attention, in recent years. However, accurate prediction of robot motion in indoor environments with limited visibility is challenging. While vision-based and light detection and ranging (LiDAR) sensors are commonly used for motion detection and localization of robotic arms, they are privacy-invasive and depend on a clear line-of-sight (LOS) for precise measurements. In cases where additional sensors are not available or LOS is not possible, these technologies may not be the best option. This paper proposes a novel method that employs channel state information (CSI) from WiFi signals affected by robotic arm motion. We developed a convolutional neural network (CNN) model to classify four different activities of a Franka Emika robotic arm. The implemented method seeks to accurately predict robot motion even in scenarios in which the robot is obscured by obstacles, without relying on any attached or internal sensors.
- “No falls, no resets: Reliable humanoid behavior in the darpa robotics challenge,” in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids). IEEE, 2015, pp. 623–630.
- “The kuka-dlr lightweight robot arm-a new reference platform for robotics research and manufacturing,” in ISR 2010 (41st international symposium on robotics) and ROBOTIK 2010 (6th German conference on robotics). VDE, 2010, pp. 1–8.
- “Mobile bin picking with an anthropomorphic service robot,” in 2013 IEEE International Conference on Robotics and Automation. IEEE, 2013, pp. 2327–2334.
- “Robotic surgery: a current perspective,” Annals of surgery, vol. 239, no. 1, pp. 14, 2004.
- “Mobile robots navigation in indoor environments using kinect sensor,” in 2012 Second Brazilian Conference on Critical Embedded Systems. IEEE, 2012, pp. 36–41.
- “2d LiDAR and camera fusion in 3d modeling of indoor environment,” in 2015 National Aerospace and Electronics Conference (NAECON). IEEE, 2015, pp. 379–383.
- “LiDAR-based stabilization, navigation and localization for uavs operating in dark indoor environments,” in 2021 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, 2021, pp. 243–251.
- “Sensorless sensing in wireless networks: Implementation and measurements,” in 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks. IEEE, 2006, pp. 1–8.
- “Challenges: device-free passive localization for wireless environments,” in Proceedings of the 13th annual ACM international conference on Mobile computing and networking, 2007, pp. 222–229.
- “E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures,” in Proceedings of the 20th annual international conference on Mobile computing and networking, 2014, pp. 617–628.
- “3d tracking via body radio reflections,” in 11th {normal-{\{{USENIX}normal-}\}} Symposium on Networked Systems Design and Implementation ({normal-{\{{NSDI}normal-}\}} 14), 2014, pp. 317–329.
- “Zero-effort cross-domain gesture recognition with wi-fi,” New York, NY, USA, 2019, MobiSys ’19, p. 313–325, Association for Computing Machinery.
- “Joint human orientation-activity recognition using wifi signals for human-machine interaction,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Minirocket: A very fast (almost) deterministic transform for time series classification,” in Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 2021, pp. 248–257.
- “Hand tremor recognition based on RFID doppler frequency shift signal,” in 2022 IEEE 32nd International Workshop on Machine Learning for Signal Processing (MLSP), 2022, pp. 1–6.
- “Wlan based pose estimation for mobile robots,” IFAC Proceedings Volumes, vol. 41, no. 2, pp. 10433–10438, 2008.
- “The franka emika robot: A reference platform for robotics research and education,” IEEE Robotics & Automation Magazine, vol. 29, no. 2, pp. 46–64, 2022.
- “Deep learning for time series classification: a review,” Data mining and knowledge discovery, vol. 33, no. 4, pp. 917–963, 2019.
- “Litehar: lightweight human activity recognition from wifi signals with random convolution kernels,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 4068–4072.
- “Dropout training as adaptive regularization,” Advances in neural information processing systems, vol. 26, 2013.
- Matthew Gast, 802.11ac: A Survival Guide, O’Reilly Media, Inc., 1st edition, 2013.
- “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International conference on machine learning. pmlr, 2015, pp. 448–456.
- “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.