Papers
Topics
Authors
Recent
2000 character limit reached

Orientation selectivity properties for the affine Gaussian derivative and the affine Gabor models for visual receptive fields (2304.11920v9)

Published 24 Apr 2023 in q-bio.NC

Abstract: This paper presents a theoretical analysis of the orientation selectivity of simple and complex cells that can be well modelled by the generalized Gaussian derivative model for visual receptive fields, with the purely spatial component of the receptive fields determined by oriented affine Gaussian derivatives for different orders of spatial differentiation. A detailed mathematical analysis is presented for the three different cases of either: (i) purely spatial receptive fields, (ii) space-time separable spatio-temporal receptive fields and (iii) velocity-adapted spatio-temporal receptive fields. Closed-form theoretical expressions for the orientation selectivity curves for idealized models of simple and complex cells are derived for all these main cases, and it is shown that the orientation selectivity of the receptive fields becomes more narrow, as a scale parameter ratio $\kappa$, defined as the ratio between the scale parameters in the directions perpendicular to vs. parallel with the preferred orientation of the receptive field, increases. It is also shown that the orientation selectivity becomes more narrow with increasing order of spatial differentiation in the underlying affine Gaussian derivative operators over the spatial domain. For comparison, we also present a corresponding theoretical orientation selectivity analysis for purely spatial receptive fields according to an affine Gabor model. The results from that analysis are consistent with the results obtained from the affine Gaussian derivative model,in the respect that the orientation selectivity becomes more narrow when making the receptive fields wider in the direction perpendicular to the preferred orientation of the receptive field.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (74)
  1. E. Adelson and J. Bergen. Spatiotemporal energy models for the perception of motion. Journal of Optical Society of America, A 2:284–299, 1985.
  2. P. Berkes and L. Wiskott. Slow feature analysis yields a rich repertoire of complex cell properties. Journal of Vision, 5(6):579–602, 2005.
  3. R. N. Bracewell. The Fourier Transform and its Applications. McGraw-Hill, New York, 1999. 3rd edition.
  4. M. Carandini. What simple and complex cells compute. The Journal of Physiology, 577(2):463–466, 2006.
  5. M. Carandini and D. L. Ringach. Predictions of a recurrent model of orientation selectivity. Vision Research, 37(21):3061–3071, 1997.
  6. Spatial and temporal properties of cone signals in alert macaque primary visual cortex. Journal of Neuroscience, 26(42):10826–10846, 2006.
  7. A. De and G. D. Horwitz. Spatial receptive field structure of double-opponent cells in macaque V1. Journal of Neurophysiology, 125(3):843–857, 2021.
  8. G. C. DeAngelis and A. Anzai. A modern view of the classical receptive field: Linear and non-linear spatio-temporal processing by V1 neurons. In L. M. Chalupa and J. S. Werner, editors, The Visual Neurosciences, volume 1, pages 704–719. MIT Press, 2004.
  9. Receptive field dynamics in the central visual pathways. Trends in Neuroscience, 18(10):451–457, 1995.
  10. Learning the invariance properties of complex cells from their responses to natural stimuli. European Journal of Neuroscience, 15(3):475–486, 2002.
  11. Nonlinear directionally selective subunits in complex cells of cat striate cortex. Journal of Neurophysiology, 58(1):33–65, 1987.
  12. D. Ferster and K. D. Miller. Neural mechanisms of orientation selectivity in the visual cortex. Annual Review of Neuroscience, 23(1):441–471, 2000.
  13. From filters to features: Scale-space analysis of edge and blur coding in human vision. Journal of Vision, 7(13):7.1–21, 2007.
  14. Origin and function of tuning diversity in Macaque visual cortex. Neuron, 88(4):819–831, 2015.
  15. M. Hansard and R. Horaud. A differential model of the complex cell. Neural Computation, 23(9):2324–2357, 2011.
  16. T. Hansen and H. Neumann. A recurrent model of contour integration in primary visual cortex. Journal of Vision, 8(8):8.1–25, 2008.
  17. D. J. Heeger. Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9:181–197, 1992.
  18. Edges and bars: where do people see features in 1-D images? Vision Research, 45(4):507–525, 2005.
  19. Receptive fields of single neurones in the cat’s striate cortex. J Physiol, 147:226–238, 1959.
  20. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol, 160:106–154, 1962.
  21. Brain and Visual Perception: The Story of a 25-Year Collaboration. Oxford University Press, 2005.
  22. The orientation selectivity of color-responsive neurons in Macaque V1. The Journal of Neuroscience, 28(32):8096–8106, 2008.
  23. J. Jones and L. Palmer. The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. of Neurophysiology, 58:1187–1211, 1987a.
  24. J. Jones and L. Palmer. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J. of Neurophysiology, 58:1233–1258, 1987b.
  25. J. J. Koenderink. The structure of images. Biological Cybernetics, 50(5):363–370, 1984.
  26. J. J. Koenderink and A. J. van Doorn. Representation of local geometry in the visual system. Biological Cybernetics, 55(6):367–375, 1987.
  27. J. J. Koenderink and A. J. van Doorn. Receptive field families. Biological Cybernetics, 63:291–298, 1990.
  28. J. J. Koenderink and A. J. van Doorn. Generic neighborhood operators. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(6):597–605, Jun. 1992.
  29. How are complex cell properties adapted to the statistics of natural stimuli? Journal of Neurophysiology, 91(1):206–212, 2004.
  30. Prediction of orientation selectivity from receptive field architecture in simple cells of cat visual cortex. Neuron, 30(1):263–274, 2001.
  31. T. Lindeberg. Feature detection with automatic scale selection. International Journal of Computer Vision, 30(2):77–116, 1998.
  32. T. Lindeberg. Generalized Gaussian scale-space axiomatics comprising linear scale-space, affine scale-space and spatio-temporal scale-space. Journal of Mathematical Imaging and Vision, 40(1):36–81, 2011.
  33. T. Lindeberg. A computational theory of visual receptive fields. Biological Cybernetics, 107(6):589–635, 2013.
  34. T. Lindeberg. Time-causal and time-recursive spatio-temporal receptive fields. Journal of Mathematical Imaging and Vision, 55(1):50–88, 2016.
  35. T. Lindeberg. Temporal scale selection in time-causal scale space. Journal of Mathematical Imaging and Vision, 58(1):57–101, 2017.
  36. T. Lindeberg. Dense scale selection over space, time and space-time. SIAM Journal on Imaging Sciences, 11(1):407–441, 2018.
  37. T. Lindeberg. Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade. Journal of Mathematical Imaging and Vision, 62(1):120–148, 2020.
  38. T. Lindeberg. Normative theory of visual receptive fields. Heliyon, 7(1):e05897:1–20, 2021. doi: 10.1016/j.heliyon.2021.e05897.
  39. T. Lindeberg. Covariance properties under natural image transformations for the generalized Gaussian derivative model for visual receptive fields. Frontiers in Computational Neuroscience, 17:1189949:1–23, 2023.
  40. T. Lindeberg. Do the receptive fields in the primary visual cortex span a variability over the degree of elongation of the receptive fields? In preparation, 2024.
  41. T. Lindeberg and J. Gårding. Shape-adapted smoothing in estimation of 3-D shape cues from affine distortions of local 2-D structure. Image and Vision Computing, 15(6):415–434, 1997.
  42. D. G. Lowe. Towards a computational model for object recognition in IT cortex. In Biologically Motivated Computer Vision, volume 1811 of Springer LNCS, pages 20–31. Springer, 2000.
  43. S. Marcelja. Mathematical description of the responses of simple cortical cells. Journal of Optical Society of America, 70(11):1297–1300, 1980.
  44. K. V. Mardia. Statistics of Directional Data. Academic Press, London, 1972.
  45. Blurred edges look faint, and faint edges look sharp: The effect of a gradient threshold in a multi-scale edge coding model. Vision Research, 47(13):1705–1720, 2007.
  46. P. Merolla and K. Boahn. A recurrent model of orientation maps with simple and complex cells. In Advances in Neural Information Processing Systems (NIPS 2004), pages 995–1002, 2004.
  47. Receptive field organization of complex cells in the cat’s striate cortex. The Journal of Physiology, 283(1):79–99, 1978.
  48. Neuronal selectivity and local map structure in visual cortex. Neuron, 57(5):673–679, 2008.
  49. A cascade model of information processing and encoding for retinal prosthesis. Neural Regeneration Research, 11(4):646, 2016.
  50. M. Porat and Y. Y. Zeevi. The generalized Gabor scheme of image representation in biological and machine vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):452–468, 1988.
  51. N. J. Priebe. Mechanisms of orientation selectivity in the primary visual cortex. Annual Review of Vision Science, 2:85–107, 2016.
  52. D. L. Ringach. Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. Journal of Neurophysiology, 88:455–463, 2002.
  53. D. L. Ringach. Mapping receptive fields in primary visual cortex. Journal of Physiology, 558(3):717–728, 2004.
  54. Orientation selectivity in macaque V1: Diversity and laminar dependence. Journal of Neuroscience, 22(13):5639–5651, 2002.
  55. D. Rose and C. Blakemore. An analysis of orientation selectivity in the cat’s visual cortex. Experimental Brain Research, 20:1–17, 1974.
  56. Spatiotemporal elements of macaque V1 receptive fields. Neuron, 46(6):945–956, 2005.
  57. S. Sadeh and S. Rotter. Statistics and geometry of orientation selectivity in primary visual cortex. Biological Cybernetics, 108:631–653, 2014.
  58. Supranormal orientation selectivity of visual neurons in orientation-restricted animals. Scientific Reports, 5(1):16712, 2015.
  59. Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. Journal of Neurophysiology, 39(6):1320–1333, 1976.
  60. Emergence of orientation selectivity in the mammalian visual pathway. Journal of Neuroscience, 33(26):10616–10624, 2013.
  61. Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations. Nature Neuroscience, 7(10):1129–1135, 2004.
  62. T. Serre and M. Riesenhuber. Realistic modeling of simple and complex cell tuning in the HMAX model, and implications for invariant object recognition in cortex. Technical Report AI Memo 2004-017, MIT Computer Science and Artifical Intelligence Laboratory, 2004.
  63. Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition. Neuron, 38(5):689–699, 2003.
  64. An emergent model of orientation selectivity in cat visual cortical simple cells. Journal of Neuroscience, 15(8):5448–5465, 1995.
  65. H. Sompolinsky and R. Shapley. New perspectives on the mechanisms for orientation selectivity. Current Opinion in Neurobiology, 7(4):514–522, 1997.
  66. Isolation of relevant visual features from random stimuli for cortical complex cells. Journal of Neuroscience, 22(24):10811–10818, 2002.
  67. Spatial structure of complex cell receptive fields measured with natural images. Neuron, 45(5):781–791, 2005.
  68. Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity. Vision Research, 40(2):3685–3702, 2000.
  69. Inception loops discover what excites neurons most using deep predictive models. Nature Neuroscience, 22(12):2060–2065, 2019.
  70. Mach edges: Local features predicted by 3rd derivative spatial filtering. Vision Research, 49(14):1886–1893, 2009.
  71. Q. Wang and M. W. Spratling. Contour detection in colour images using a neurophysiologically inspired model. Cognitive Computation, 8(6):1027–1035, 2016.
  72. R. A. Young. The Gaussian derivative model for spatial vision: I. Retinal mechanisms. Spatial Vision, 2(4):273–293, 1987.
  73. The Gaussian derivative model for spatio-temporal vision: II. Cortical data. Spatial Vision, 14(3, 4):321–389, 2001.
  74. The Gaussian derivative model for spatio-temporal vision: I. Cortical model. Spatial Vision, 14(3, 4):261–319, 2001.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (1)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 2 likes about this paper.