A time-causal and time-recursive analogue of the Gabor transform (2308.14512v9)
Abstract: This paper presents a time-causal analogue of the Gabor filter, as well as a both time-causal and time-recursive analogue of the Gabor transform, where the proposed time-causal representations obey both temporal scale covariance and a cascade property with a simplifying kernel over temporal scales. The motivation behind these constructions is to enable theoretically well-founded time-frequency analysis over multiple temporal scales for real-time situations, or for physical or biological modelling situations, when the future cannot be accessed, and the non-causal access to future in Gabor filtering is therefore not viable for a time-frequency analysis of the system. We develop the theory for these representations, obtained by replacing the Gaussian kernel in Gabor filtering with a time-causal kernel, referred to as the time-causal limit kernel, which guarantees simplification properties from finer to coarser levels of scales in a time-causal situation, similar as the Gaussian kernel can be shown to guarantee over a non-causal temporal domain. In these ways, the proposed time-frequency representations guarantee well-founded treatment over multiple scales, in situations when the characteristic scales in the signals, or physical or biological phenomena, to be analyzed may vary substantially, and additionally all steps in the time-frequency analysis have to be fully time-causal.
- D. Gabor, “Theory of communication,” Journal of the IEE, vol. 93, pp. 429–457, 1946.
- P. I. M. Johannesma, “The pre-response stimulus ensemble of neurons in the cochlear nucleus,” in IPO Symposium on Hearing Theory, Eindhoven, The Netherlands, 1972, pp. 58–69.
- R. D. Patterson, I. Nimmo-Smith, J. Holdsworth, and P. Rice, “An efficient auditory filterbank based on the Gammatone function,” in A meeting of the IOC Speech Group on Auditory Modelling at RSRE, vol. 2:7, 1987.
- R. D. Patterson, M. H. Allerhand, and C. Giguere, “Time-domain modeling of peripheral auditory processing: A modular architecture and a software platform,” The Journal of the Acoustical Society of America, vol. 98, no. 4, pp. 1890–1894, 1995.
- M. J. Hewitt and R. Meddis, “A computer model of amplitude-modulation sensitivity of single units in the inferior colliculus,” The Journal of the Acoustical Society of America, vol. 95, no. 4, pp. 2145–2159, 1994.
- T. Lindeberg and A. Friberg, “Idealized computational models of auditory receptive fields,” PLOS ONE, vol. 10, no. 3, pp. e0 119 032:1–58, 2015.
- S. Qian and D. Chen, “Joint time-frequency analysis,” IEEE Signal Processing Magazine, vol. 16, no. 2, pp. 52–67, 1999.
- T. Lindeberg, “A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time,” Biological Cybernetics, vol. 117, no. 1–2, pp. 21–59, 2023.
- J. J. Koenderink, “Scale-time,” Biological Cybernetics, vol. 58, pp. 159–162, 1988.
- T. Lindeberg and D. Fagerström, “Scale-space with causal time direction,” in Proc. European Conf. on Computer Vision (ECCV’96), ser. Springer LNCS, vol. 1064, Cambridge, UK, Apr. 1996, pp. 229–240.
- T. Lindeberg, “Time-causal and time-recursive spatio-temporal receptive fields,” Journal of Mathematical Imaging and Vision, vol. 55, no. 1, pp. 50–88, 2016.
- I. J. Schoenberg, “On Pòlya frequency functions. ii. Variation-diminishing integral operators of the convolution type,” Acta Sci. Math. (Szeged), vol. 12, pp. 97–106, 1950.
- T. Lindeberg, “Temporal scale selection in time-causal scale space,” Journal of Mathematical Imaging and Vision, vol. 58, no. 1, pp. 57–101, 2017.
- ——, “Normative theory of visual receptive fields,” Heliyon, vol. 7, no. 1, pp. e05 897:1–20, 2021.
- H. G. Feichtinger and K. Gröchenig, “Gabor wavelets and the Heisenberg group: Gabor expansions and short time Fourier transform from the group theoretical point of view,” in Wavelets: A Tutorial in Theory and Applications, C. K. Chui, Ed. Academic Press, 1992, vol. 2, pp. 359–398.
- I. J. Schoenberg, “Some analytical aspects of the problem of smoothing,” in Courant Anniversary Volume, Studies and Essays, New York, 1948, pp. 351–370.
- Y. Jansson and T. Lindeberg, “Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields,” Journal of Mathematical Imaging and Vision, vol. 60, no. 9, pp. 1369–1398, 2018.
- T. Lindeberg, “Covariance properties under natural image transformations for the generalized Gaussian derivative model for visual receptive fields,” Frontiers in Computational Neuroscience, vol. 17, pp. 1 189 949:1–23, 2023.
- T. Lindeberg, “Scale-space for discrete signals,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 234–254, Mar. 1990.
- W. M. Hartmann, “Pitch, periodicity, and auditory organization,” The Journal of the Acoustical Society of America, vol. 100, no. 6, pp. 3491–3502, 1996.
- B. C. J. Moore, “Frequency difference limens for short-duration tones,” The Journal of the Acoustical Society of America, vol. 54, no. 3, pp. 610–619, 1973.
- T. Lindeberg, “Discrete approximations of Gaussian smoothing and Gaussian derivatives,” arXiv preprint arXiv:2311.11317, 2023.