Do the receptive fields in the primary visual cortex span a variability over the degree of elongation of the receptive fields? (2404.04858v10)
Abstract: This paper presents results of combining (i) theoretical analysis regarding connections between the orientation selectivity and the elongation of receptive fields for the affine Gaussian derivative model with (ii) biological measurements of orientation selectivity in the primary visual cortex, to investigate if (iii) the receptive fields can be regarded as spanning a variability in the degree of elongation. From an in-depth theoretical analysis of idealized models for the receptive fields of simple and complex cells in the primary visual cortex, we have established that the directional selectivity becomes more narrow with increasing elongation of the receptive fields. By comparison with previously established biological results, concerning broad vs. sharp orientation tuning of visual neurons in the primary visual cortex, we demonstrate that those underlying theoretical predictions, in combination with these biological results, are consistent with a previously formulated biological hypothesis, stating that the biological receptive field shapes should span the degrees of freedom in affine image transformations, to support affine covariance over the population of receptive fields in the primary visual cortex. Based on this possible indirect support for the working hypothesis concerning affine covariance, we formulate a set of testable predictions that could be used to, with neurophysiological experiments, judge if the receptive fields in the primary visual cortex of higher mammals could be regarded as spanning a variability over the eccentricity or the elongation of the receptive fields, and, if so, then also characterize if such a variability would, in a structured way, be related to the pinwheel structure in the visual cortex.
- E. Adelson and J. Bergen. Spatiotemporal energy models for the perception of motion. Journal of Optical Society of America, A 2:284–299, 1985.
- A geometric model of multi-scale orientation preference maps via Gabor functions. Journal of Mathematical Imaging and Vision, 60:900–912, 2018.
- P. Berkes and L. Wiskott. Slow feature analysis yields a rich repertoire of complex cell properties. Journal of Vision, 5(6):579–602, 2005.
- G. G. Blasdel. Orientation selectivity, preference and continuity in monkey striate cortex. Journal of Neuroscience, 12(8):3139–3161, 1992.
- T. Bonhoeffer and A. Grinvald. Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns. Nature, 353:429–431, 1991.
- R. N. Bracewell. The Fourier Transform and its Applications. McGraw-Hill, New York, 1999. 3rd edition.
- M. Carandini. What simple and complex cells compute. The Journal of Physiology, 577(2):463–466, 2006.
- M. Carandini and D. L. Ringach. Predictions of a recurrent model of orientation selectivity. Vision Research, 37(21):3061–3071, 1997.
- Spatial and temporal properties of cone signals in alert macaque primary visual cortex. Journal of Neuroscience, 26(42):10826–10846, 2006.
- A. De and G. D. Horwitz. Spatial receptive field structure of double-opponent cells in macaque V1. Journal of Neurophysiology, 125(3):843–857, 2021.
- G. C. DeAngelis and A. Anzai. A modern view of the classical receptive field: Linear and non-linear spatio-temporal processing by V1 neurons. In L. M. Chalupa and J. S. Werner, editors, The Visual Neurosciences, volume 1, pages 704–719. MIT Press, 2004.
- Receptive field dynamics in the central visual pathways. Trends in Neuroscience, 18(10):451–457, 1995.
- Learning the invariance properties of complex cells from their responses to natural stimuli. European Journal of Neuroscience, 15(3):475–486, 2002.
- Nonlinear directionally selective subunits in complex cells of cat striate cortex. Journal of Neurophysiology, 58(1):33–65, 1987.
- D. Ferster and K. D. Miller. Neural mechanisms of orientation selectivity in the visual cortex. Annual Review of Neuroscience, 23(1):441–471, 2000.
- From filters to features: Scale-space analysis of edge and blur coding in human vision. Journal of Vision, 7(13):7.1–21, 2007.
- Origin and function of tuning diversity in Macaque visual cortex. Neuron, 88(4):819–831, 2015.
- M. Hansard and R. Horaud. A differential model of the complex cell. Neural Computation, 23(9):2324–2357, 2011.
- T. Hansen and H. Neumann. A recurrent model of contour integration in primary visual cortex. Journal of Vision, 8(8):8.1–25, 2008.
- D. J. Heeger. Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9:181–197, 1992.
- Edges and bars: where do people see features in 1-D images? Vision Research, 45(4):507–525, 2005.
- Receptive fields of single neurones in the cat’s striate cortex. J Physiol, 147:226–238, 1959.
- Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol, 160:106–154, 1962.
- Brain and Visual Perception: The Story of a 25-Year Collaboration. Oxford University Press, 2005.
- The orientation selectivity of color-responsive neurons in Macaque V1. The Journal of Neuroscience, 28(32):8096–8106, 2008.
- J. Jones and L. Palmer. The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. of Neurophysiology, 58:1187–1211, 1987a.
- J. Jones and L. Palmer. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J. of Neurophysiology, 58:1233–1258, 1987b.
- Functional implications of orientation maps in primary visual cortex. Nature Communications, 7(1):13529, 2016.
- J. J. Koenderink. The structure of images. Biological Cybernetics, 50(5):363–370, 1984.
- J. J. Koenderink and A. J. van Doorn. Representation of local geometry in the visual system. Biological Cybernetics, 55(6):367–375, 1987.
- J. J. Koenderink and A. J. van Doorn. Generic neighborhood operators. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(6):597–605, Jun. 1992.
- How are complex cell properties adapted to the statistics of natural stimuli? Journal of Neurophysiology, 91(1):206–212, 2004.
- Prediction of orientation selectivity from receptive field architecture in simple cells of cat visual cortex. Neuron, 30(1):263–274, 2001.
- T. Lindeberg. A computational theory of visual receptive fields. Biological Cybernetics, 107(6):589–635, 2013a.
- T. Lindeberg. Invariance of visual operations at the level of receptive fields. PLOS ONE, 8(7):e66990, 2013b.
- T. Lindeberg. Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade. Journal of Mathematical Imaging and Vision, 62(1):120–148, 2020.
- T. Lindeberg. Normative theory of visual receptive fields. Heliyon, 7(1):e05897:1–20, 2021. doi: 10.1016/j.heliyon.2021.e05897.
- T. Lindeberg. Covariance properties under natural image transformations for the generalized Gaussian derivative model for visual receptive fields. Frontiers in Computational Neuroscience, 17:1189949:1–23, 2023.
- T. Lindeberg. Orientation selectivity properties for the affine Gaussian derivative and the affine Gabor models for visual receptive fields. In preparation, 2024.
- X. Liu and P. A. Robinson. Analytic model for feature maps in the primary visual cortex. Frontiers in Computational Neuroscience, 16:2, 2022.
- D. G. Lowe. Towards a computational model for object recognition in IT cortex. In Biologically Motivated Computer Vision, volume 1811 of Springer LNCS, pages 20–31. Springer, 2000.
- S. Marcelja. Mathematical description of the responses of simple cortical cells. Journal of Optical Society of America, 70(11):1297–1300, 1980.
- Blurred edges look faint, and faint edges look sharp: The effect of a gradient threshold in a multi-scale edge coding model. Vision Research, 47(13):1705–1720, 2007.
- P. Merolla and K. Boahn. A recurrent model of orientation maps with simple and complex cells. In Advances in Neural Information Processing Systems (NIPS 2004), pages 995–1002, 2004.
- Receptive field organization of complex cells in the cat’s striate cortex. The Journal of Physiology, 283(1):79–99, 1978.
- Neuronal selectivity and local map structure in visual cortex. Neuron, 57(5):673–679, 2008.
- A cascade model of information processing and encoding for retinal prosthesis. Neural Regeneration Research, 11(4):646, 2016.
- J. Petitot. The neurogeometry of pinwheels as a sub-Riemannian contact structure. Journal of Physiology-Paris, 97(2–3):265–309, 2003.
- M. Porat and Y. Y. Zeevi. The generalized Gabor scheme of image representation in biological and machine vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):452–468, 1988.
- N. J. Priebe. Mechanisms of orientation selectivity in the primary visual cortex. Annual Review of Vision Science, 2:85–107, 2016.
- D. L. Ringach. Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. Journal of Neurophysiology, 88:455–463, 2002.
- D. L. Ringach. Mapping receptive fields in primary visual cortex. Journal of Physiology, 558(3):717–728, 2004.
- Orientation selectivity in macaque V1: Diversity and laminar dependence. Journal of Neuroscience, 22(13):5639–5651, 2002.
- D. Rose and C. Blakemore. An analysis of orientation selectivity in the cat’s visual cortex. Experimental Brain Research, 20:1–17, 1974.
- Spatiotemporal elements of macaque V1 receptive fields. Neuron, 46(6):945–956, 2005.
- S. Sadeh and S. Rotter. Statistics and geometry of orientation selectivity in primary visual cortex. Biological Cybernetics, 108:631–653, 2014.
- Supranormal orientation selectivity of visual neurons in orientation-restricted animals. Scientific Reports, 5(1):16712, 2015.
- Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. Journal of Neurophysiology, 39(6):1320–1333, 1976.
- Emergence of orientation selectivity in the mammalian visual pathway. Journal of Neuroscience, 33(26):10616–10624, 2013.
- Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations. Nature Neuroscience, 7(10):1129–1135, 2004.
- T. Serre and M. Riesenhuber. Realistic modeling of simple and complex cell tuning in the HMAX model, and implications for invariant object recognition in cortex. Technical Report AI Memo 2004-017, MIT Computer Science and Artifical Intelligence Laboratory, 2004.
- Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition. Neuron, 38(5):689–699, 2003.
- An emergent model of orientation selectivity in cat visual cortical simple cells. Journal of Neuroscience, 15(8):5448–5465, 1995.
- H. Sompolinsky and R. Shapley. New perspectives on the mechanisms for orientation selectivity. Current Opinion in Neurobiology, 7(4):514–522, 1997.
- N. V. Swindale. The development of topography in the visual cortex: A review of models. Network: Computation in Neural Systems, 7(2):161–247, 1996.
- Isolation of relevant visual features from random stimuli for cortical complex cells. Journal of Neuroscience, 22(24):10811–10818, 2002.
- Spatial structure of complex cell receptive fields measured with natural images. Neuron, 45(5):781–791, 2005.
- Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity. Vision Research, 40(2):3685–3702, 2000.
- Mach edges: Local features predicted by 3rd derivative spatial filtering. Vision Research, 49(14):1886–1893, 2009.
- Q. Wang and M. W. Spratling. Contour detection in colour images using a neurophysiologically inspired model. Cognitive Computation, 8(6):1027–1035, 2016.
- R. A. Young. The Gaussian derivative model for spatial vision: I. Retinal mechanisms. Spatial Vision, 2(4):273–293, 1987.
- The Gaussian derivative model for spatio-temporal vision: II. Cortical data. Spatial Vision, 14(3, 4):321–389, 2001.
- The Gaussian derivative model for spatio-temporal vision: I. Cortical model. Spatial Vision, 14(3, 4):261–319, 2001.