Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Sound Terminology Describing Production and Perception of Sonification (2312.00091v1)

Published 30 Nov 2023 in cs.SD and eess.AS

Abstract: Sonification research is intrinsically interdisciplinary. Consequently, a proper documentation of, and interdisciplinary discourse about a sonification is often hindered by terminology discrepancies between involved disciplines, i.e., the lack of a common sound terminology in sonification research. Without a common ground, a researcher from one discipline may have troubles understanding the implementation and imagining the resulting sound perception of a sonification, if the sonification is described by a researcher from another discipline. To find a common ground, I consulted literature on interdisciplinary research and discourse, identified problems that occur in sonification, and applied the recommended solutions. As a result, I recommend considering three aspects of sonification individually, namely 1.) Sound Design Concept, 2.) Objective and 3.) Method, clarifying which discipline is involved in which aspect, and sticking to this discipline's terminology. As two requirements of sonifications are that they are a) reproducible and b) interpretable, I recommend documenting and discussing every sonification design once using audio engineering terminology, and once using psychoacoustic terminology. The appendix provides comprehensive lists of sound terms from both disciplines, together with relevant literature and a clarification of often misunderstood and misused terms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (87)
  1. Sonification report: Status of the field and research agenda. International Community for Auditory Display, 1998.
  2. Interactive sonification. In John G. Neuhoff Thomas Hermann, Andy Hunt, editor, The Sonification Handbook, chapter 11, pages 273–298. COST and Logos, Berlin, 2011.
  3. Thomas Hermann. Taxonomy and definitions for sonification and auditory display. In 14th International Conference on Auditory Display, page 8 pages, Paris, Jun 2008.
  4. Introduction. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, chapter 1, pages 1–6. COST and Logos, Berlin, 2011.
  5. The Sonification Handbook. COST and Logos, Berlin, 2011.
  6. Simon Carlile. Psychoacoustics. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, chapter 3, pages 41–61. COST and Logos, Berlin, 2011.
  7. John G. Neuhoff. Perception, cognition and action in auditory displays. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, chapter 4, pages 63–85. COST and Logos, Berlin, 2011.
  8. Sonification design and aesthetics. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, pages 145–171. COST and Logos, Berlin, 2011.
  9. David Worrall. Sonification Design. Springer, Cham, 2019.
  10. Sonification as an interdisciplinary working process. In 12th International Conference on Auditory Display (ICAD), London, UK, May 2006.
  11. Christian Dayé and Alberto de Campo. Sounds sequential: sonification in the social sciences. Interdisciplinary Science Reviews, 31(4):349–364, Dec 2013.
  12. John G. Neuhoff. Is sonification doomed to fail? In Proc. 25th International Conference on Auditory Display, pages 327–330, Newcastle upon Tyne, Jun 2019.
  13. Theory of sonification. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, chapter 2, pages 9–39. COST and Logos, Berlin, 2011.
  14. Christian Dayé. Crafting sonifications: levels of interdisciplinary exchange in group discussions and their empirical assessment. In 21st International Conference on Auditory Display (ICAD2015), pages 54–57, Graz, Austria, June 2015.
  15. Carlos Adrian Cuevas-Garcia. Understanding interdisciplinarity in its argumentative context: thought and rhetoric in the perception of academic practices. Interdisciplinary Science Reviews, 43(1):54–73, Jan 2018.
  16. Interdisciplinary Research and Trans-disciplinary Validity Claims. Springer, Cham, 2015.
  17. Challenges facing interdisciplinary researchers: Findings from a professional development workshop. PLoS One, 17(4):e0267234, April 2022.
  18. Detecting interdisciplinary semantic drift for knowledge organization based on normal cloud model. Journal of King Saud University — Computer and Information Sciences, 35(6):101569, 2023.
  19. A Strata-Based Approach to Discussing Artistic Data Sonification. Leonardo, 55(5):516–520, Oct 2022.
  20. Thomas Metcalf. Graphical Data Sets as Compositional Structure: Sonification of Color Graphs in RGB for Clarinet and Piano. Leonardo, 54(3):329–336, Jun 2021.
  21. Carla Scaletti. Sonification ≠\neq≠ music. In Roger T. Dean and Alex McLean, editors, The Oxford Handbook of Algorithmic Music. Oxford University Press, New York, NY, 2018.
  22. Kernel Regression Mapping for Vocal EEG Sonification. In Proceedings of the 14th International Conference on Auditory Display (ICAD2008), Paris, France, June 2008.
  23. Semantic models of sound-driven design: Designing with listening in mind. Design Studies, 83:101134, Nov 2022.
  24. PAMPAS: A PsychoAcoustical Method for the Perceptual Analysis of multidimensional Sonification. Frontiers in Neuroscience, 16, Oct 2022.
  25. Using psychoacoustical models for information sonification. In 12th International Conference on Auditory Display, pages 113–120, London, Jun 2006.
  26. Psychoacoustically motivated sonification for surgeons. International Journal of Computer Assisted Radiology and Surgery, 12((Suppl 1):1):265–266, Jun 2017.
  27. Psychoacoustical interactive sonification for short range navigation. Acta Acustica united with Acustica, 104(6):1075–1093, Nov/Dec 2018.
  28. Psychoacoustical signal processing for three-dimensional sonification. In 25th International Conference on Auditory Displays (ICAD2019), pages 277–284, Newcastle, June 2019.
  29. Rhetorical strategies for sound design and auditory display: A case study. International Journal of Design, 7(2):67–82, Aug 2013.
  30. Eduardo Reck Miranda. The music of particle collisions. Nature Phys, 12:721, Aug 2016.
  31. Chris Hayward. Listening to the earth sing. In Gregory Kramer, editor, Auditory Display: Sonification, Audification, and Auditory Interfaces, pages 369–404. Addison-Wesley, Boston, MA, 1994.
  32. Translating sonifications. J. Audio Eng. Soc, 60(11):926–935, Nov 2012.
  33. Novel pulse oximetry sonifications for neonatal oxygen saturation monitoring: A laboratory study. Human Factors, 58(2):344–359, Mar 2016.
  34. Novel auditory displays in highly automated vehicles: Sonification improves driver situation awareness, perceived workload, and overall experience. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 65(1):586–590, Sep 2021.
  35. Tim Ziemer. Psychoacoustic Music Sound Field Synthesis. Springer, Cham, 2020.
  36. A systematic review of mapping strategies for the sonification of physical quantities. PLOS ONE, 9(4):e96018, Dec 2013.
  37. Karin Bijsterveld. Sonic Skills. Listening for Knowledge in Science, Medicine and Engineering. Palgrave Macmillan, 2019.
  38. The Auditory Dictionary. University of Washington Press, Seattle, WA, 3rd edition, 2005.
  39. FM Theory & Applications. By Musicians for Musicians. Yamaha Music Foundation, Tokyo, 1986.
  40. Albrecht Schneider. Pitch and pitch perception. In Rolf Bader, editor, Springer Handbook of Systematic Musicology, pages 605–685. Springer Berlin Heidelberg, Berlin, Heidelberg, 2018.
  41. An investigation of using music to provide navigation cues. In 5th International Conference on Auditory Display (ICAD1998), Glasgow, UK, November 1998.
  42. A psychoacoustic sound design for pulse oximetry. In Proceedings of the 25th International Conference on Auditory Display (ICAD 2019), Newcastle, June 2019.
  43. A survey on common practice in designing audio in the user interface. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI…but Not as We Know It, BCS-HCI ’07, page 187–194, Swindon, GBR, Sep 2007. BCS Learning & Development Ltd.
  44. A Supercollider Class for Vowel Synthesis and its use for Sonification. In Proceedings of the 17th International Conference on Auditory Display (ICAD2011), Budapest, Hungary, June 2011.
  45. Stream-based sonification diagrams. In 14th International Conference on Auditory Display (ICAD2008), Paris, Jun 2008.
  46. Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces. Journal of Organised Sound, 7(2):127–144, Aug 2002.
  47. sonecules: a python sonification architecture. In 28th International Conference on Auditory Display (ICAD2023), pages 62–69, Norrköping, Sweden, Jun 2023.
  48. Sonex: An evaluation exchange framework for reproducible sonification. In Proceedings of the 19th International Conference on Auditory Display (ICAD2013), Lodz, Jul 2013.
  49. Sonification design for complex work domains: Dimensions and distractors. Journal of Experimental Psychology: Applied, 15(3):183–198, Mar 2009.
  50. Sonification and reliability — implications for signal design. In International Conference on Auditory Display, pages 154–159, Montréal, Jun 2007.
  51. Auditory display as an aid for prosthetic hand manipulation: Preliminary results. In 17th International Conference on Auditory Display (ICAD2011), Budapest, Jun 2011.
  52. F. Kilander and P. Loennqvist. A whisper in the woods - an ambient soundscape for peripheral awareness of remote processes. In 8th International Conference on Auditory Display (ICAD2002), Kyoto, Japan, July 2002.
  53. Stefano Kalonaris. Reef elegy: An auditory displayof hawaii’‘s 2019 coral bleaching data. In 28th International Conference on Auditory Disply (ICAD2023), pages 70–77, Norrköping, June 2023.
  54. Psychoacoustic auditory display for navigation: an auditory assistance system for spatial orientation tasks. J Multimodal User Interfaces, 13(3):205–218, Sep 2019.
  55. BUZZ: An auditory interface user experience scale. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA ’18, pages 1–6, New York, NY, USA, Apr 2018. Association for Computing Machinery.
  56. The CURAT sonification game: Gamification for remote sonification evaluation. In 26th International Conference on Auditory Display (ICAD2021), pages 233–240, Virtual conference, June 2021.
  57. Experimental evaluation of multimodal human computer interface for tactical audio applications. In ICME, volume 2, pages 29–32, Ischia, Jul 2002.
  58. Evaluation of auditory display. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, pages 111–144. COST and Logos, Berlin, 2011.
  59. Keith V. Nesbitt. Comparing and reusing visualisation and sonification designs using the ms-taxonomy. In 10th International Conference on Auditory Display (ICAD2004), June 2004.
  60. Towards a unified terminology for sonification and visualization. Personal and Ubiquitous Computing, 27(5), Oct 2023.
  61. Paul Vickers. Ways of listening and modes of being: Electroacoustic auditory display. Journal of Sonic Studies, 2, 2012.
  62. Visda Goudarzi. Exploring a taxonomy of interaction in interactive sonification systems. In Tareq Ahram, Redha Taiar, Karine Langlois, and Arnaud Choplin, editors, Human Interaction, Emerging Technologies and Future Applications III, pages 140–145, Cham, Aug 2021. Springer.
  63. Ecological psychoacoustics and auditory displays: Hearing, grouping, and meaning making. In John G. Neuhoff, editor, Ecological Psychoacoustics, chapter 6, pages 149–174. Elsevier, Amsterdam, 2004.
  64. Laboratory methods for experimental sonification. In Thomas Hermann, Andy Hunt, and John G. Neuhoff, editors, The Sonification Handbook, chapter 10, pages 237–272. COST and Logos, Berlin, 2011.
  65. William M. Hartmann. Principles of Musical Acoustics. Springer, 2013.
  66. Juan G. Roederer. The Physics and Psychophysics of Music. An Introduction. Springer, New York, NY, 4 edition, 2009.
  67. Jerry H. Ginsberg. Acoustics-A Textbook for Engineers and Physicists. Volume I: Fundamentals. Springer, Cham, 2018.
  68. Jerry H. Ginsberg. Acoustics-A Textbook for Engineers and Physicists. Volume I: Applications. Springer, Cham, corrected edition, 2021.
  69. Acoustical Society of America and Institute of Radio Engineers. Acoustical Terminology. American Standard Association, New York, NY, 1951.
  70. J.P. Lefebvre. Physical basis of acoustics. In Paul Filippi, Dominique Habault, Jean-Pierre Lefebvre, and Aimé Bergassoli, editors, Acoustics: Basic Physics, Theory and Methods. Academic Press, London, 1999.
  71. Tim Ziemer. Source width in music production. methods in stereo, ambisonics, and wave field synthesis. In Albrecht Schneider, editor, Studies in Musical Acoustics and Psychoacoustics, pages 299–340. Springer, Cham, 2017.
  72. Robert Mores. Music studio technology. In Rolf Bader, editor, Springer Handbook of Systematic Musicology, pages 221–258. Springer, 2018.
  73. Alexandros Drymonitis. Digital Electronics for Musicians. Apress, Berkeley, CA, 2015.
  74. Eric J. Heller. An Experiential Approach to Sound, Music, and Psychoacoustics. Princeton University Press, Princeton, NJ, 2013.
  75. Michel Bruneau. Fundamentals of Acoustics. ISTE, London, 2006.
  76. Mitch Gallagher. The Music Tech Dictionary: A Glossary of Audio-Related Terms and Technologies. Course Technology PTR, Boston, MA, 2009.
  77. Sound Topology, Duality, Coherence and Wave-Mixing. Springer, Cham, 2017.
  78. Eberhard Sengpiel. Forum für Mikrofonaufnahmetechnik und Tonstudiotechnik, chapter What is Amplitude? sengpielaudio, Berlin, 2014.
  79. Albrecht Schneider. Fundamentals. In Rolf Bader, editor, Springer Handbook of Systematic Musicology, pages 559–603. Springer, Berlin, Heidelberg, 2018.
  80. Albrecht Schneider. Perception of timbre and sound color. In Rolf Bader, editor, Springer Handbook of Systematic Musiwology, chapter 32, pages 687–726. Springer, Berlin, Heidelberg, 2018.
  81. Barry Truax, editor. Handbook for Acoustic Ecology. Cambridge Street Publishing, Burnaby, BC, 2nd edition, 1999.
  82. Justin London. Hearing in time: Psychological aspects of musical meter. Oxford University Press, New York, NY, 2004.
  83. Philippe Guillaume. Music and Acoustics. ISTE, London, 2006.
  84. Psychoacoustics. Facts and Models. Springer, Berlin, Heidelberg, 3 edition, 2007.
  85. Stanley A. Gelfand. Hearing. An introduction to psychological and physiological acoustics. Informa, New York and Basel, second edition, 1990.
  86. Jens Blauert. Spatial Hearing. The Psychophysics of Human Sound Source Localization. MIT Press, Cambridge , MA, revised edition, 1997.
  87. W. Aures. Berechnungsverfahren für den sensorischen wohlklang beliebiger schallsignale (a model for calculating the sensory euphony of various sounds). Acustica, 59(2):130–141, Dec 1985.

Summary

We haven't generated a summary for this paper yet.