Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Exploring the Diversity of Music Experiences for Deaf and Hard of Hearing People (2401.09025v1)

Published 17 Jan 2024 in cs.HC and cs.CY

Abstract: Sensory substitution or enhancement techniques have been proposed to enable deaf or hard of hearing (DHH) people to listen to and even compose music. However, little is known about how such techniques enhance DHH people's music experience. Since deafness is a spectrum -- as are DHH people's preferences and perceptions of music -- a more situated understanding of their interaction with music is needed. To understand the music experience of this population, we conducted social media analyses, both qualitatively and quantitatively, in the deaf and hard of hearing Reddit communities. Our content analysis revealed that DHH people leveraged sign language and visual/haptic cues to feel the music and preferred familiar, non-lyrical, instrument-heavy, and loud music. In addition, hearing aids were not customized for music, and the visual/haptic techniques developed were not widely adopted by DHH people, leading to their suboptimal music experiences. The DHH community embodied mutual support among music lovers, evidenced by active information sharing and Q&A around music and hearing loss. We reflect on design justice for DHH people's music experience and propose practical design implications to create a more accessible music experience for them.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. Effect of audio-tactile congruence on vibrotactile music enhancement. The Journal of the Acoustical Society of America 152, 6 (2022), 3396–3409.
  2. Felipe Alves Araújo and Carlos Eduardo Batista. 2016. Auris: system for facilitating the musical perception for the hearing impaired. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web. 135–142.
  3. Composing vibrotactile music: A multi-sensory experience with the emoti-chair. In 2012 ieee haptics symposium (haptics). IEEE, 509–515.
  4. Using music therapy in (re) habilitation of prelingual deaf cochlear implant children. Biom J Sci Tech Res 1, 1 (2017), 105–110.
  5. Adrian Bossey. 2020. Accessibility all areas? UK live music industry perceptions of current practice and Information and Communication Technology improvements to accessibility for music festival attendees who are deaf or disabled. International Journal of Event and Festival Management 11, 1 (2020), 6–25.
  6. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
  7. Doga Cavdir and Ge Wang. 2020. Felt sound: A shared musical experience for the deaf and hard of hearing. In Proceedings of the 20th international conference on new interfaces for musical expression (nime-20).
  8. DanceVibe: Assistive Dancing for the Hearing Impaired. In Mobile Computing, Applications, and Services: 9th International Conference, MobiCASE 2018, Osaka, Japan, February 28–March 2, 2018, Proceedings 9. Springer, 21–39.
  9. Alice-Ann Darrow. 1993. The role of music in deaf culture: Implications for music educators. Journal of Research in Music Education 41, 2 (1993), 93–110.
  10. Tatiane Ribeiro Morais De Paula and Patrícia Lima Martins Pederiva. 2017. Musical Experience in Deaf Culture. International Journal of Technology and Inclusive Education 6, 2 (2017), 1098–1107.
  11. Vitune: A visualizer tool to allow the deaf and hard of hearing to see music with their eyes. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.
  12. Twitter Sentiment Analysis as an Evaluation and Service Base On Python Textblob. In IOP Conference Series: Materials Science and Engineering, Vol. 1125. IOP Publishing, 012034.
  13. Musegan: Multi-track sequential generative adversarial networks for symbolic music generation and accompaniment. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
  14. Understanding emotional expression with haptic feedback vest patterns and immersive virtual reality. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 183–188.
  15. Joan Dahms Fahey and Lois Birkenshaw. 1972. Education of the deaf bypassing the ear: the perception of music by feeling and touch. Music Educators Journal 58, 8 (1972), 44–51.
  16. Deaf people feeling music rhythm by using a sensing and actuating device. Sensors and Actuators A: Physical 267 (2017), 431–442.
  17. David W Fourney and Deborah I Fels. 2009. Creating access to music through visualization. In 2009 ieee toronto international conference science and technology for humanity (tic-sth). IEEE, 939–944.
  18. Emma Frid. 2019. Accessible digital musical instruments—a review of musical interfaces in inclusive music practice. Multimodal Technologies and Interaction 3, 3 (2019), 57.
  19. Hearing aids and music: the experiences of D/deaf musicians. In Ninth Triennial Conference of the European Society for the Cognitive Sciences of Music, Manchester, UK, August. 17–22.
  20. Michael S Grierson. 2011. Making music with images: interactive audiovisual performance systems for the deaf. (2011).
  21. Hyomin Han and Taewook Kim. 2023. Opportunities to Support Communal Experiences of Deaf and Hard-of-Hearing People in Live Popular Music Concerts. In Companion Proceedings of the 2023 ACM International Conference on Supporting Group Work. 36–38.
  22. Identifying emotions in music through electrical hearing in deaf children using cochlear implants. Cochlear implants international 12, 1 (2011), 21–26.
  23. Designing Gestures for Digital Musical Instruments: Gesture Elicitation Study with Deaf and Hard of Hearing People. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility. 1–8.
  24. Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People. In Proceedings of the 2021 ACM Symposium on Spatial User Interaction. 1–2.
  25. The design of tactile musical devices for the deaf. ([n. d.]).
  26. Designing tactile musical devices with and for deaf users: a case study. In Proceedings of the International Conference on the Multimodal Experience of Music, Sheffield, UK. 23–25.
  27. Keith A Kaiser and Krista E Johnson. 2000. The effect of an interactive experience on music majors’ perceptions of music for deaf students. Journal of Music Therapy 37, 3 (2000), 222–234.
  28. Modelling perceptual elements of music in a vibrotactile display for deaf users: A field study. In 2009 Second International Conferences on Advances in Computer-Human Interactions. IEEE, 249–254.
  29. Seen music: ambient music data visualization for children with hearing impairments. In Proceedings of the 14th International Conference on Interaction Design and Children. 426–429.
  30. Karen Kyriakou. 2022. Teaching music to deaf students: A personal reflection. Australian Journal of Music Education 54, 2 (2022), 52–59.
  31. Anabel Maler. 2015. Musical expression among deaf and hearing song signers. The Oxford handbook of music and disability studies (2015), 73–91.
  32. Muscaps: Generating captions for music audio. In 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8.
  33. Towards Inclusive Streaming: Building Multimodal Music Experiences for the Deaf and Hard of Hearing. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–7.
  34. An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. In Proceedings of the sigchi conference on human factors in computing systems. 337–346.
  35. Enhancing musical experience for the hearing-impaired using visual and haptic displays. Human–Computer Interaction 28, 2 (2013), 115–160.
  36. Keita Ohshiro and Mark Cartwright. 2022. How people who are deaf, Deaf, and hard of hearing use technology in creative sound activities. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility. 1–4.
  37. Russ C Palmer and Stina Ojala. 2022. Vibrational Music Therapy with D/deaf clients. In Voices: A World Forum for Music Therapy, Vol. 22.
  38. Supporting rhythm activities of deaf children using music-sensory-substitution systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–10.
  39. Ad-hoc access to musical sound for deaf individuals. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. 285–286.
  40. MuSS-bits: sensor-display blocks for deaf people to explore musical sounds. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. 72–80.
  41. Audio-tactile rendering: a review on technology and methods to convey musical information through the sense of touch. Sensors 21, 19 (2021), 6575.
  42. Music lessons improve auditory perceptual and cognitive performance in deaf children. Frontiers in human neuroscience 8 (2014), 488.
  43. E Glenn Schellenberg. 2005. Music and cognitive abilities. Current Directions in Psychological Science 14, 6 (2005), 317–320.
  44. Music education for the deaf: characteristics, barriers and successful practices. Educação e Pesquisa 46 (2020).
  45. Be Me Vest-Exploring the Emotional Effects of Music and Sound-Based Vibrotactile Stimuli. In International Conference on Human-Computer Interaction. Springer, 318–331.
  46. Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. In New Interfaces for Musical Expression.
  47. Community-Driven Information Accessibility: Online Sign Language Content Creation within d/Deaf Communities. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–24.
  48. Towards Equitable Online Participation: A Case of Older Adult Content Creators’ Role Transition on Short-form Video Sharing Platforms. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1–22.
  49. Feeling the beat: Bouncing synchronization to vibrotactile music in hearing and early deaf people. Frontiers in neuroscience 11 (2017), 507.
  50. Wearable musical haptic sleeves for people with hearing impairment. In Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments. 146–151.
  51. Corinne Scalia Watkins. 2017. The Deaf Perspective: A Content Analysis Study to Determine Deaf and Hard-of-Hearing Individuals’ Perceptions and Attitudes Towards Music. Ph. D. Dissertation. The Florida State University.
  52. Whitney Wright. 2014. Bridging Music and the Early Childhood Curriculum in Listening and Spoken Language Programs for Children who are Deaf or Hard of Hearing. (2014).
  53. Tianqiang Yan and Yuwei Liu. 2022. An Adaptive Musical Vibrotactile System (MuViT) for Modern Smartphones. In International Forum on Digital TV and Wireless Multimedia Communications. Springer, 436–448.
  54. Understanding tensions in music accessibility through song signing for and with d/Deaf and Non-d/Deaf persons. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
  55. Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video. In Arts, Vol. 12. MDPI, 156.
  56. Iterative Design of An Accessible Crypto Wallet for Blind Users. arXiv preprint arXiv:2306.06261 (2023).

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets