Skip to Main content Skip to Navigation
Journal articles

A dual foveal-peripheral visual processing model implements efficient saccade selection

Abstract : We develop a visuomotor model that implements visual search as a focal accuracy-seeking policy, with the target's position and category drawn independently from a common generative process. Consistently with the anatomical separation between the ventral versus dorsal pathways, the model is composed of two pathways that respectively infer what to see and where to look. The "What" network is a classical deep learning classifier that only processes a small region around the center of fixation, providing a "foveal" accuracy. In contrast, the "Where" network processes the full visual field in a biomimetic fashion, using a log-polar retinotopic encoding, which is preserved up to the action selection level. In our model, the foveal accuracy is used as a monitoring signal to train the "Where" network, much like in the "actor/critic" framework. After training, the "Where" network provides an "accuracy map" that serves to guide the eye toward peripheral objects. Finally, the comparison of both networks' accuracies amounts to either selecting a saccade or keeping the eye focused at the center to identify the target. We test this setup on a simple task of finding a digit in a large, cluttered image. Our simulation results demonstrate the effectiveness of this approach, increasing by one order of magnitude the radius of the visual field toward which the agent can detect and recognize a target, either through a single saccade or with multiple ones. Importantly, our log-polar treatment of the visual information exploits the strong compression rate performed at the sensory level, providing ways to implement visual search in a sublinear fashion, in contrast with mainstream computer vision.
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download

https://hal-amu.archives-ouvertes.fr/hal-02947410
Contributor : Laurent Perrinet <>
Submitted on : Thursday, September 24, 2020 - 10:54:36 AM
Last modification on : Wednesday, October 14, 2020 - 3:47:36 AM

File

i1534-7362-20-8-22_1597915038....
Publication funded by an institution

Licence


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License

Identifiers

Collections

Citation

Emmanuel Daucé, Pierre Albiges, Laurent U Perrinet. A dual foveal-peripheral visual processing model implements efficient saccade selection. Journal of Vision, Association for Research in Vision and Ophthalmology, 2020, 20 (8), pp.22. ⟨10.1167/jov.20.8.22⟩. ⟨hal-02947410⟩

Share

Metrics

Record views

37

Files downloads

61