HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

A dual foveal-peripheral visual processing model implements efficient saccade selection

Abstract : We develop a visuomotor model that implements visual search as a focal accuracy-seeking policy, with the target's position and category drawn independently from a common generative process. Consistently with the anatomical separation between the ventral versus dorsal pathways, the model is composed of two pathways that respectively infer what to see and where to look. The "What" network is a classical deep learning classifier that only processes a small region around the center of fixation, providing a "foveal" accuracy. In contrast, the "Where" network processes the full visual field in a biomimetic fashion, using a log-polar retinotopic encoding, which is preserved up to the action selection level. In our model, the foveal accuracy is used as a monitoring signal to train the "Where" network, much like in the "actor/critic" framework. After training, the "Where" network provides an "accuracy map" that serves to guide the eye toward peripheral objects. Finally, the comparison of both networks' accuracies amounts to either selecting a saccade or keeping the eye focused at the center to identify the target. We test this setup on a simple task of finding a digit in a large, cluttered image. Our simulation results demonstrate the effectiveness of this approach, increasing by one order of magnitude the radius of the visual field toward which the agent can detect and recognize a target, either through a single saccade or with multiple ones. Importantly, our log-polar treatment of the visual information exploits the strong compression rate performed at the sensory level, providing ways to implement visual search in a sublinear fashion, in contrast with mainstream computer vision.
Complete list of metadata

Cited literature [46 references]  Display  Hide  Download

Contributor : Laurent Perrinet Connect in order to contact the contributor
Submitted on : Thursday, September 24, 2020 - 10:54:36 AM
Last modification on : Wednesday, November 3, 2021 - 9:56:28 AM
Long-term archiving on: : Thursday, December 3, 2020 - 4:43:05 PM


Publication funded by an institution


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License




Emmanuel Daucé, Pierre Albiges, Laurent U Perrinet. A dual foveal-peripheral visual processing model implements efficient saccade selection. Journal of Vision, Association for Research in Vision and Ophthalmology, 2020, 20 (8), pp.22. ⟨10.1167/jov.20.8.22⟩. ⟨hal-02947410⟩



Record views


Files downloads