Sound Field Estimation Using Deep Kernel Learning Regularized by the Wave Equation (2407.04417v1)
Abstract: In this work, we introduce a spatio-temporal kernel for Gaussian process (GP) regression-based sound field estimation. Notably, GPs have the attractive property that the sound field is a linear function of the measurements, allowing the field to be estimated efficiently from distributed microphone measurements. However, to ensure analytical tractability, most existing kernels for sound field estimation have been formulated in the frequency domain, formed independently for each frequency. To address the analytical intractability of spatio-temporal kernels, we here propose to instead learn the kernel directly from data by the means of deep kernel learning. Furthermore, to improve the generalization of the deep kernel, we propose a method for regularizing the learning process using the wave equation. The representational advantages of the deep kernel and the improved generalization obtained by using the wave equation regularization are illustrated using numerical simulations.
- “Spatial active noise control based on kernel interpolation of sound field,” IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 29, pp. 3052–3063, 2021.
- “A unified approach to generating sound zones using variable span linear filters,” in IEEE Int. Conf. Acoust., Speech, Signal Process., Calgary, April 2018, pp. 491–495.
- Mark A Poletti, “Three-dimensional surround sound systems based on spherical harmonics,” J. Audio Eng. Soc., vol. 53, no. 11, pp. 1004–1025, 2005.
- “Gaussian processes for sound field reconstruction,” J. Acoust. Soc. Amer., vol. 149, no. 2, pp. 1107–1119, 2021.
- “Kernel ridge regression with constraint of helmholtz equation for sound field interpolation,” in Int. Workshop Acoust. Signal Enhancement, Tokyo, September 2018, IEEE, pp. 1–440.
- “Directionally weighted wave field estimation exploiting prior information on source direction,” IEEE Trans. Signal Process., vol. 69, pp. 2383–2395, 2021.
- “Recursive spatial covariance estimation with sparse priors for sound field interpolation,” in IEEE Statistical Signal Process. Workshop, Hanoi, 7 2023, pp. 517–521.
- “Sound field estimation based on physics-constrained kernel interpolation adapted to environment,” Authorea Preprints, 2023.
- “Room impulse response interpolation using a sparse spatio-temporal representation of the sound field,” IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 25, no. 10, pp. 1929–1941, 2017.
- “Physics-informed neural network for volumetric sound field reconstruction of speech signals,” arXiv preprint arXiv:2403.09524, 2024.
- “Sound field reconstruction in rooms: Inpainting meets super-resolution,” J. Acoust. Soc. Amer., vol. 148, no. 2, pp. 649–659, 2020.
- “Deep kernel learning,” in Int. Conf. on Artificial Intelligence and Statistics, Cadiz, May 2016, vol. 51, pp. 370–378.
- “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” J. of Comp. Physics, vol. 378, pp. 686–707, 2019.
- C. E. Rasmussen, “Gaussian processes in machine learning,” in Summer school on machine learning, pp. 63–71. Springer, 2003.
- “A representer theorem for deep kernel learning,” J. of Machine Learning Research, vol. 20, no. 64, pp. 1–32, 2019.
- “Universal kernels.,” J. of Machine Learning Research, vol. 7, no. 12, 2006.
- “On feature collapse and deep kernel learning for single forward pass uncertainty,” arXiv preprint arXiv:2102.11409, 2021.
- “The promises and pitfalls of deep kernel learning,” in Uncertainty in Artificial Intelligence. PMLR, 2021, pp. 1206–1216.
- “Manifold gaussian processes for regression,” in Int. joint conf. on neural networks. IEEE, 2016, pp. 3338–3345.
- “Simple and principled uncertainty estimation with deterministic deep learning via distance awareness,” Advances in neural information process. syst., vol. 33, pp. 7498–7512, 2020.
- “Meta-learning feature representations for adaptive gaussian processes via implicit differentiation,” arXiv preprint arXiv:2205.02708, 2022.
- “Machine learning of linear differential equations using gaussian processes,” J. of Comp. Physics, vol. 348, pp. 683–693, 2017.
- “The matrix cookbook,” Technical University of Denmark, vol. 7, no. 15, pp. 510, 2008.
- “Image method for efficiently simulating small-room acoustics,” J. Acoust. Soc. Am., vol. 65, pp. 943–950, 1979.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- “Room impulse response reconstruction with physics-informed deep learning,” J. Acoust. Soc. Amer., vol. 155, no. 2, pp. 1048–1059, 2024.
- “Implicit neural representations with periodic activation functions,” Advances in neural information process. syst., vol. 33, pp. 7462–7473, 2020.