A2D: Anywhere Anytime Drumming
Abstract: The drum kit, which has only been around for around 100 years, is a popular instrument in many music genres such as pop, rock, and jazz. However, the road to owning a kit is expensive, both financially and space-wise. Also, drums are more difficult to move around compared to other instruments, as they do not fit into a single bag. We propose a no-drums approach that uses only two sticks and a smartphone or a webcam to provide an air-drumming experience. The detection algorithm combines deep learning tools with tracking methods for an enhanced user experience. Based on both quantitative and qualitative testing with humans-in-the-loop, we show that our system has zero misses for beginner level play and negligible misses for advanced level play. Additionally, our limited human trials suggest potential directions for future research.
- Aerodrums, “Aerodrums : Air drums and virtual electronic drum kit,” \urlhttps://aerodrums.com/, 2013.
- Aeroband, “Pocketdrum 2 pro : Play and practice the drums anywhere you go,” \urlhttps://www.aeroband.net/, 2016.
- “Air drums: Playing drums using computer vision,” in 2019 International Symposium on Multimedia and Communication Technology (ISMAC). IEEE, 2019, pp. 1–6.
- “Virtual musical instruments: air drums,” in Proceedings of the Sixth International Conference on Information Technology in Asia (CITA 2009), Kuching, Sarawak, 2009, pp. 95–99.
- “Air drums: A computer vision based drums simulator,” in 2010 IEEE 18th Signal Processing and Communications Applications Conference. IEEE, 2010, pp. 844–847.
- “Imagenet classification with deep convolutional neural networks,” Communications of the ACM, vol. 60, no. 6, pp. 84–90, 2017.
- “Real-time grasp detection using convolutional neural networks,” in 2015 IEEE international conference on robotics and automation (ICRA). IEEE, 2015, pp. 1316–1322.
- “Efficientdet: Scalable and efficient object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 10781–10790.
- “Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,” arXiv preprint arXiv:2207.02696, 2022.
- Rudolph Emil Kalman, “A new approach to linear filtering and prediction problems,” 1960.
- Stanley F Schmidt, “The kalman filter-its recognition and development for aerospace applications,” Journal of Guidance and Control, vol. 4, no. 1, pp. 4–7, 1981.
- Helmut Haas, “The influence of a single echo on the audibility of speech,” Journal of the Audio Engineering Society, vol. 20, no. 2, pp. 146–159, 1972.
- “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
- “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009, pp. 248–255.
- “Microsoft coco: Common objects in context,” in European conference on computer vision. Springer, 2014, pp. 740–755.
- Glenn Jocher, “ultralytics/yolov5: v7.0 - YOLOv5 SOTA Realtime Instance Segmentation,” Nov 2020.
- “Cspnet: A new backbone that can enhance learning capability of cnn,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, 2020, pp. 390–391.
- “Spatial pyramid pooling in deep convolutional networks for visual recognition,” IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 9, pp. 1904–1916, 2015.
- “Path aggregation network for instance segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 8759–8768.
- “Yolov3: An incremental improvement,” arXiv preprint arXiv:1804.02767, 2018.
- “Video object tracking using adaptive kalman filter,” Journal of Visual Communication and Image Representation, vol. 17, no. 6, pp. 1190–1208, 2006.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.