Skip to Main content Skip to Navigation
Journal articles

Hearing flashes and seeing beeps: Timing audiovisual events

Abstract : Many events from daily life are audiovisual (AV). Handclaps produce both visual and acoustic signals that are transmitted in air and processed by our sensory systems at different speeds, reaching the brain multisensory integration areas at different moments. Signals must somehow be associated in time to correctly perceive synchrony. This project aims at quantifying the mutual temporal attraction between senses and characterizing the different interaction modes depending on the offset. In every trial participants saw four beep-flash pairs regularly spaced in time, followed after a variable delay by a fifth event in the test modality (auditory or visual). A large range of AV offsets was tested. The task was to judge whether the last event came before/after what was expected given the perceived rhythm, while attending only to the test modality. Flashes were perceptually shifted in time toward beeps, the attraction being stronger for lagging than leading beeps. Conversely, beeps were not shifted toward flashes, indicating a nearly total auditory capture. The subjective timing of the visual component resulting from the AV interaction could easily be forward but not backward in time, an intuitive constraint stemming from minimum visual processing delays. Finally, matching auditory and visual time-sensitivity with beeps embedded in pink noise produced very similar mutual attractions of beeps and flashes. Breaking the natural auditory preference for timing allowed vision to take over as well, showing that this preference is not hardwired.
Document type :
Journal articles
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download

https://hal-amu.archives-ouvertes.fr/hal-01473873
Contributor : Manuel Vidal <>
Submitted on : Wednesday, February 22, 2017 - 11:25:24 AM
Last modification on : Thursday, December 19, 2019 - 12:18:02 PM
Long-term archiving on: : Tuesday, May 23, 2017 - 12:40:32 PM

File

Vidal (2017) - PlosOne - Timin...
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Manuel Vidal. Hearing flashes and seeing beeps: Timing audiovisual events. PLoS ONE, Public Library of Science, 2017, 44, pp.2875 - 2875. ⟨10.1371/journal.pone.0172028⟩. ⟨hal-01473873⟩

Share

Metrics

Record views

171

Files downloads

252