Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Table tennis ball spin estimation with an event camera (2404.09870v1)

Published 15 Apr 2024 in cs.CV

Abstract: Spin plays a pivotal role in ball-based sports. Estimating spin becomes a key skill due to its impact on the ball's trajectory and bouncing behavior. Spin cannot be observed directly, making it inherently challenging to estimate. In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate for quickly and accurately observing the ball's logo to estimate the spin due to the motion blur. Event cameras do not suffer as much from motion blur, thanks to their high temporal resolution. Moreover, the sparse nature of the event stream solves communication bandwidth limitations many frame cameras face. To the best of our knowledge, we present the first method for table tennis spin estimation using an event camera. We use ordinal time surfaces to track the ball and then isolate the events generated by the logo on the ball. Optical flow is then estimated from the extracted events to infer the ball's spin. We achieved a spin magnitude mean error of $10.7 \pm 17.3$ rps and a spin axis mean error of $32.9 \pm 38.2\deg$ in real time for a flying ball.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Focus adjustment (c++) - metavision sdk docs 4.5.2 documentation.
  2. Black-box vs. gray-box: A case study on learning table tennis ball trajectory prediction with spin and impacts. In Proceedings of the 5th Annual Learning for Dynamics and Control Conference (L4DC), pages 878–890. PMLR, 2023.
  3. HASTE: multi-hypothesis asynchronous speeded-up tracking of events. In 31st British Machine Vision Conference 2020, BMVC 2020. BMVA Press, 2020.
  4. Event-based plane-fitting optical flow for dynamic vision sensors in fpga. In 2018 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 2018.
  5. Sensor-based stroke detection and stroke type classification in table tennis. In Proceedings of the 2015 ACM International Symposium on Wearable Computers - ISWC ’15. ACM Press, 2015.
  6. Ball speed and spin estimation in table tennis using a racket-mounted inertial sensor. In Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, 2017.
  7. Single-Image 3D Reconstruction of Ball Velocity and Spin From Motion Blur - An Experiment in Motion-from-Blur. SciTePress - Science and and Technology Publications, 2008.
  8. Event-driven stereo visual tracking algorithm to solve object occlusion. IEEE Transactions on Neural Networks and Learning Systems, 29(9):4223–4237, 2018.
  9. High speed event camera tracking. In 31st British Machine Vision Conference 2020, BMVC 2020. BMVA Press, 2020.
  10. Asynchronous tracking-by-detection on adaptive time surfaces for event-based object tracking. In Proceedings of the 27th ACM International Conference on Multimedia. ACM, 2019.
  11. Dynamic model based ball trajectory prediction for a robot ping-pong player. In 2010 IEEE International Conference on Robotics and Biomimetics. IEEE, 2010.
  12. Detecting stable keypoints from events through image gradient prediction. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 2021.
  13. Feedback control of event cameras. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 2021.
  14. Dynamic obstacle avoidance for quadrotors with event cameras. Science Robotics, 5(40), 2020.
  15. Event-based agile object catching with a quadrupedal robot. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023.
  16. A study on spin-rate measurement using a uniquely marked moving ball. In 2009 ICCAS-SICE, pages 3439–3442. IEEE, 2009.
  17. Event-based vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(1):154–180, 2022.
  18. Robust Stroke Recognition via Vision and IMU in Robotic Table Tennis, page 379–390. Springer International Publishing, 2021.
  19. Puck: Parallel surface and convolution-kernel tracking for event-based cameras, 2022.
  20. Dense continuous-time optical flow from event cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence, page 1–12, 2024.
  21. luvharris: A practical corner detector for event-cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(12):10087–10098, 2022.
  22. Tracking the spin on a ping pong ball with the quaternion bingham filter. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2014.
  23. Spindoe: A ball spin estimation method for table tennis robot. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2023.
  24. Semi-supervised Learning of Optical Flow by Flow Supervisor, page 302–318. Springer Nature Switzerland, 2022.
  25. What Matters in Unsupervised Optical Flow, page 557–572. Springer International Publishing, 2020.
  26. Table tennis stroke recognition using two-dimensional human pose estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 4576–4584, 2021.
  27. An iterative image registration technique with an application to stereo vision (darpa). In Proceedings of DARPA Image Understanding Workshop (IUW ’81), pages 121 – 130, 1981.
  28. Optical flow estimation by matching time surface with event-based cameras. Sensors, 21(4):1150, 2021.
  29. Bernd Pfrommer. Frequency cam: Imaging periodic signals in real-time, 2022.
  30. U-Net: Convolutional Networks for Biomedical Image Segmentation, page 234–241. Springer International Publishing, 2015.
  31. Leveraging human pose estimation model for stroke classification in table tennis. In Working Notes Proceedings of the MediaEval 2020 Workshop, Online, 14-15 December 2020. CEUR-WS.org, 2020.
  32. Fast image reconstruction with an event camera. In 2020 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 2020.
  33. Fast event-based optical flow estimation by triplet matching. IEEE Signal Processing Letters, 29:2712–2716, 2022.
  34. Trajectory prediction of spinning ball based on fuzzy filtering and local modeling for robotic ping–pong player. IEEE Transactions on Instrumentation and Measurement, 62(11):2890–2900, 2013.
  35. Alexander Szep. Measuring ball spin in monocular video. In Proc. 16th Comput. Vis. Winter Workshop, pages 83–89. Citeseer, 2011.
  36. Spin measurement system for table tennis balls based on asynchronous non-high-speed cameras. International Journal of Computer Science in Sport, 23(1):37–53, 2024.
  37. Measuring ball spin by image registration. Proc. 10th Frontiers of Computer Vision, pages 269–274, 2004.
  38. Estimating the spin of a table tennis ball using inverse compositional image alignment. In 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2012.
  39. Spin detection in robotic table tennis. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020.
  40. RAFT: Recurrent All-Pairs Field Transforms for Optical Flow, page 402–419. Springer International Publishing, 2020.
  41. Pitching a baseball: tracking high-speed motion with multi-exposure images. ACM Transactions on Graphics, 23(3):540–547, 2004.
  42. A novel trajectory-based ball spin estimation method for table tennis robot. IEEE Transactions on Industrial Electronics, page 1–11, 2024.
  43. Real-time spin estimation of ping-pong ball using its natural brand. IEEE Transactions on Instrumentation and Measurement, 64(8):2280–2290, 2015.
  44. Crsot: Cross-resolution object tracking using unaligned frame and event cameras. arXiv preprint arXiv: 2401.02826, 2024.
Citations (6)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now