Transhuman Ansambl - Voice Beyond Language (2405.03134v1)
Abstract: In this paper we present the design and development of the Transhuman Ansambl, a novel interactive singing-voice interface which senses its environment and responds to vocal input with vocalisations using human voice. Designed for live performance with a human performer and as a standalone sound installation, the ansambl consists of sixteen bespoke virtual singers arranged in a circle. When performing live, the virtual singers listen to the human performer and respond to their singing by reading pitch, intonation and volume cues. In a standalone sound installation mode, singers use ultrasonic distance sensors to sense audience presence. Developed as part of the 1st author's practice-based PhD and artistic practice as a live performer, this work employs the singing-voice to explore voice interactions in HCI beyond language, and innovative ways of live performing. How is technology supporting the effect of intimacy produced through voice? Does the act of surrounding the audience with responsive virtual singers challenge the traditional roles of performer-listener? To answer these questions, we draw upon the 1st author's experience with the system, and the interdisciplinary field of voice studies that consider the voice as the sound medium independent of language, capable of enacting a reciprocal connection between bodies.
- Intangible Cultural Heritage and New Technologies: Challenges and Opportunities for Cultural Preservation and Development. In M. Ioannides, N. Magnenat-Thalmann, and G. Papagiannakis, editors, Mixed Reality and Gamification for Cultural Heritage, pages 129–158. Springer International Publishing, Cham, 2017.
- P. Beyls. Interaction and self-organisation in a society of musical agents. 2007.
- O. Bown and J. McCormack. Creative Agency: A Clearer Goal for Artificial Life in the Arts. In G. Kampis, I. Karsai, and E. Szathmáry, editors, Advances in Artificial Life. Darwin Meets von Neumann, Lecture Notes in Computer Science, pages 254–261, Berlin, Heidelberg, 2011. Springer.
- J. Butler. Critically Queer. GLQ: A Journal of Lesbian and Gay Studies, 1(1):17–32, Nov. 1993.
- The State of Speech in HCI: Trends, Themes and Challenges. Interacting with Computers, 31(4):349–371, 09 2019.
- Voices and voids: Subverting voice assistant systems through performative experiments. In Creativity and Cognition, C&C ’21, New York, NY, USA, 2021. Association for Computing Machinery.
- A Voice and Nothing More. MIT Press, Cambridge, UNITED STATES, 2006.
- S. Fasciani and L. Wyse. A voice interface for sound generators: adaptive and automatic mapping of gestures to sound. 2012.
- W. W. Gaver. Auditory icons: Using sound in computer interfaces. Human–Computer Interaction, 2(2):167–177, 1986.
- C. Goulding and D. Domic. Heritage, identity and ideological manipulation: The case of Croatia. Annals of Tourism Research, 36(1):85–102, 2009.
- C. Heim. Audience as Performer: The changing role of theatre audiences in the twenty-first century. Routledge, London, Aug. 2015.
- Voice at NIME: a Taxonomy of New Interfaces for Vocal Musical Expression. In International Conference on New Interfaces for Musical Expression, June 2022.
- F. Lenzerini. Intangible Cultural Heritage: The Living Culture of Peoples. European Journal of International Law, 22(1):101–120, 02 2011.
- O. Louvel. The Sculpted Voice: an exploration of voice in sound art. PhD thesis, D, 2019.
- I. Milačić. Sveučilište u Zagrebu Filozofski fakultet Odsjek za fonetiku. 2021.
- Voice: Vocal Aesthetics in Digital Arts and Media. MIT Press, Cambridge, UNITED STATES, 2010.
- The Singing Tree:: design of an interactive musical interface. In Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS ’97, pages 261–264, Amsterdam, The Netherlands, 1997. ACM Press.
- S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach, 4th US ed. 1995.
- A. Tanaka. Sensor-Based Musical Instruments and Interactive Music. In R. T. Dean, editor, The Oxford Handbook of Computer Music, page 0. Oxford University Press, Apr. 2011.
- K. Thomaidis and B. Macpherson. Voice Studies: Critical Approaches to Process, Performance and Experience. Taylor & Francis Group, London, UNITED KINGDOM, 2015.