Enhancing DMI Interactions by Integrating Haptic Feedback for Intricate Vibrato Technique (2405.10502v1)
Abstract: This paper investigates the integration of force feedback in Digital Musical Instruments (DMI), specifically evaluating the reproduction of intricate vibrato techniques using haptic feedback controllers. We introduce our system for vibrato modulation using force feedback, composed of Bend-aid (a web-based sequencer platform using pre-designed haptic feedback models) and TorqueTuner (an open-source 1 Degree-of-Freedom (DoF) rotary haptic device for generating programmable haptic effects). We designed a formal user study to assess the impact of each haptic mode on user experience in a vibrato mimicry task. Twenty musically trained participants rated their user experience for the three haptic modes (Smooth, Detent, and Spring) using four Likert-scale scores: comfort, flexibility, ease of control, and helpfulness for the task. Finally, we asked participants to share their reflections. Our research indicates that while the Spring mode can help with light vibrato, preferences for haptic modes vary based on musical training background. This emphasizes the need for adaptable task interfaces and flexible haptic feedback in DMI design.
- C. Frisson and M. M. Wanderley, “Challenges and opportunities of force feedback in music,” Arts, vol. 12, no. 4, 2023.
- M. Kirkegaard, M. Bredholt, C. Frisson, and M. Wanderley, “Torquetuner: A self contained module for designing rotary haptic force feedback for digital musical instruments,” in Proceedings of the international conference on new interfaces for musical expression, pp. 273–278, 2020.
- G. W. Young, D. Murphy, and J. Weeter, “A functional analysis of haptic feedback in digital musical instrument interactions,” Musical Haptics, pp. 95–122, 2018.
- M. S. O’Modhrain, Playing by feel: incorporating haptic feedback into computer-based musical instruments. Stanford University, 2001.
- Springer Nature, 2018.
- C. Nichols, “The vbow: development of a virtual violin bow haptic human-computer interface,” in Proceedings of the 2002 conference on new interfaces for musical expression, pp. 1–4, 2002.
- I. Hwang, H. Son, and J. R. Kim, “Airpiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback,” in 2017 IEEE world haptics conference (WHC), pp. 213–218, IEEE, 2017.
- M. G. Onofrei, F. Fontana, and S. Serafin, “Perceptual relevance of haptic feedback during virtual plucking, bowing and rubbing of physically-based musical resonators,” in Arts, vol. 12, p. 144, MDPI, 2023.
- P. Andrea, P. Razvan, N. C. Nilsson, N. S. Andersson, F. Fontana, N. Rolf, S. Stefania, et al., “No strings attached: Force and vibrotactile feedback in a guitar simulation,” in Proceedings of the 16th Sound & Music Computing Conference, pp. 210–216, 2019.
- A. Tanaka and A. Parkinson, “Haptic wave: A cross-modal interface for visually impaired audio producers,” in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 2150–2161, 2016.
- S. Merchel, E. Altinsoy, and M. Stamm, “Tactile music instrument recognition for audio mixers,” in Audio Engineering Society Convention 128, Audio Engineering Society, 2010.
- Y. De Pra, F. Fontana, and S. Papetti, “Interacting with digital audio effects through a haptic knob with programmable resistance,” in 2021 24th International Conference on Digital Audio Effects (DAFx), pp. 113–120, IEEE, 2021.
- A. Colter, P. Davivongsa, D. D. Haddad, H. Moore, B. Tice, and H. Ishii, “Soundforms: Manipulating sound through touch,” in Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2425–2430, 2016.
- A. Karp and B. Pardo, “Hapteq: A collaborative tool for visually impaired audio producers,” in Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences, pp. 1–4, 2017.
- B. Verplank, M. Gurevich, and M. V. Mathews, “The plank: Designing a simple haptic controller.,” in Proceedings of the 2002 Conference on New Interfaces for Musical Expression, pp. 33–36, 2002.
- T. Beamish, K. van de Doel, K. MacLean, and S. Fels, “D’groove: A haptic turntable for digital audio control,” in Proceedings of the 2003 International Conference on Auditory Display, 2003.
- A.-N. Niyonsenga, C. Frisson, and M. M. Wanderley, “TorqueTuner: A Case Study for Sustainable Haptic Development,” in 11th Intl. Workshop on Haptic and Audio Interaction Design, HAID’22, 2022.
- Cashhammn, “Guzheng-sample.” https://github.com/Cashhammn/Guzheng-sample.
- J. Matejka and G. Fitzmaurice, “Same stats, different graphs: Generating datasets with varied appearance and identical statistics through simulated annealing,” in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, (New York, NY, USA), p. 1290–1294, Association for Computing Machinery, 2017.
- Routledge, 2013.
- Princeton University Press, 1946.