Dice Question Streamline Icon: https://streamlinehq.com

Functional role of jittering movements for visual acuity

Determine whether the agents’ observed high-frequency left–right jittering movements during foraging improve visual acuity, or whether these movements are merely compensatory behaviors to avoid missing targets; rigorously assess their impact on perceptual resolution.

Information Square Streamline Icon: https://streamlinehq.com

Background

The authors observed that trained agents often did not move directly toward food but instead exhibited high-frequency lateral jitters along their trajectory. While this could be a compensatory strategy to avoid missing targets, the literature suggests that retinal jitter can enhance visual acuity in biological systems.

They explicitly state uncertainty about the cause and role of the jitters and propose to investigate whether such movement patterns also improve the agents’ visual acuity, paralleling known benefits of fixational eye movements.

References

One behaviour of our agents that we observed yet did not report is that they rarely walked straight towards food, but rather exhibit high-frequency, left and right jitters along their trajectory. We could not rule out that these were simply compensatory movements to not miss the target. Nevertheless, it is known that visual systems take advantage of retinal jitter to improve visual acuity \citep{rucci_miniature_2007,intoy_finely_2020}, and in future work we aim to identify whether the movement jitters of our agents also improve their visual acuity.

A computational approach to visual ecology with deep reinforcement learning (2402.05266 - Sokoloski et al., 7 Feb 2024) in Discussion