Performance Analysis Of Binaural Signal Matching (BSM) in the Time-Frequency Domain (2311.13390v2)
Abstract: The capture and reproduction of spatial audio is becoming increasingly popular, with the mushrooming of applications in teleconferencing, entertainment and virtual reality. Many binaural reproduction methods have been developed and studied extensively for spherical and other specially designed arrays. However, the recent increased popularity of wearable and mobile arrays requires the development of binaural reproduction methods for these arrays. One such method is binaural signal matching (BSM). However, to date this method has only been investigated with fixed matched filters designed for long audio recordings. With the aim of making the BSM method more adaptive to dynamic environments, this paper analyzes BSM with a parameterized sound-field in the time-frequency domain. The paper presents results of implementing the BSM method on a sound-field that was decomposed into its direct and reverberant components, and compares this implementation with the BSM computed for the entire sound-field, to compare performance for binaural reproduction of reverberant speech in a simulated environment.
- Archontis Politis, Leo McCormack, and Ville Pulkki, “Enhancement of ambisonic binaural reproduction using directional audio coding with optimal adaptive mixing,” in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA). IEEE, 2017, pp. 379–383.
- Markus Noisternig, Alois Sontacchi, Thomas Musil, and Robert Holdrich, “A 3d ambisonic based binaural sound reproduction system,” in Audio Engineering Society Conference: 24th International Confer- ence: Multichannel Audio, The New Reality. Audio Engineering Society, 2003.
- ZamirBen-Hur, Fabian Brinkmann, Jonathan Sheaffer, Stefan Weinzierl, and Boaz Rafaely, “Spectral equalization in binaural signals represented by order-truncated spherical harmonics,” The Journal of the Acoustical Society of America, vol. 141, no. 6, pp. 4087–4096, 2017.
- Michael A Gerzon, “Ambisonics in multichannel broadcasting and video,” Journal of the Audio Engineering Society, vol. 33, no. 11, pp. 859–871, 1985.
- Adam M O’Donovan, Dmitry N Zotkin, and Ramani Duraiswami, “Spherical microphone array based immersive audio scene rendering,” International Community for Auditory Display, 2008.
- Wookeun Song, Wolfgang Ellermeier, and Jørgen Hald, “Using beam- forming and binaural synthesis for the psychoacoustical evaluation of target sources in noise,” The Journal of the Acoustical Society of America, vol. 123, no. 2, pp. 910–924, 2008.
- P. Calamia, S. Davis, C. Smalt, and C. Weston, “A conformal, helmet-mounted microphone array for auditory situational awareness and hearing protection,” in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2017, pp. 96–100.
- Ji-Ho Chang, Chan-Hui Lee, Jin-Young Park, and Yang-Hann Kim, “A realization of sound focused personal audio system using acoustic contrast control,” The Journal of the Acoustical Society of America, vol. 125, no. 4, pp. 2091–2097, 2009.