Dice Question Streamline Icon: https://streamlinehq.com

Equivariance beyond lower-level visual areas remains unestablished

Establish whether the orientation column structure and spatiotemporal receptive fields in cortex confer equivariance to small visual transformations across the entire visual hierarchy, rather than being limited to lower-level visual areas.

Information Square Streamline Icon: https://streamlinehq.com

Background

The authors review proposals that orientation columns and spatiotemporal receptive fields may support equivariance to small visual transformations in early visual cortex.

They explicitly note that it has not been shown whether this property extends throughout higher stages of the visual hierarchy and argue that their spacetime perspective suggests such an extension should hold.

References

While there are others who have proposed that the orientation column structure and spatiotemporal receptive fields of neurons may support equivariance to small visual transformations in lower level visual areas104, this idea has not been shown to extend throughout the visual hierarchy, which we believe our perspective supports.

A Spacetime Perspective on Dynamical Computation in Neural Information Processing Systems (2409.13669 - Keller et al., 20 Sep 2024) in End of Spacetime Dynamics in Geometric Neural Representations, page 14/28