Skip to Main content Skip to Navigation
New interface
Journal articles

Hearing flashes and seeing beeps: Timing audiovisual events

Abstract : Many events from daily life are audiovisual (AV). Handclaps produce both visual and acoustic signals that are transmitted in air and processed by our sensory systems at different speeds, reaching the brain multisensory integration areas at different moments. Signals must somehow be associated in time to correctly perceive synchrony. This project aims at quantifying the mutual temporal attraction between senses and characterizing the different interaction modes depending on the offset. In every trial participants saw four beep-flash pairs regularly spaced in time, followed after a variable delay by a fifth event in the test modality (auditory or visual). A large range of AV offsets was tested. The task was to judge whether the last event came before/after what was expected given the perceived rhythm, while attending only to the test modality. Flashes were perceptually shifted in time toward beeps, the attraction being stronger for lagging than leading beeps. Conversely, beeps were not shifted toward flashes, indicating a nearly total auditory capture. The subjective timing of the visual component resulting from the AV interaction could easily be forward but not backward in time, an intuitive constraint stemming from minimum visual processing delays. Finally, matching auditory and visual time-sensitivity with beeps embedded in pink noise produced very similar mutual attractions of beeps and flashes. Breaking the natural auditory preference for timing allowed vision to take over as well, showing that this preference is not hardwired.
Document type :
Journal articles
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download
Contributor : Manuel Vidal Connect in order to contact the contributor
Submitted on : Wednesday, February 22, 2017 - 11:25:24 AM
Last modification on : Wednesday, November 3, 2021 - 9:50:56 AM
Long-term archiving on: : Tuesday, May 23, 2017 - 12:40:32 PM


Vidal (2017) - PlosOne - Timin...
Publisher files allowed on an open archive




Manuel Vidal. Hearing flashes and seeing beeps: Timing audiovisual events. PLoS ONE, 2017, 44, pp.2875 - 2875. ⟨10.1371/journal.pone.0172028⟩. ⟨hal-01473873⟩



Record views


Files downloads