June 2006
Volume 6, Issue 6
Vision Sciences Society Annual Meeting Abstract  |   June 2006
Auditory capture of visual stimuli in time is statistically optimal
Author Affiliations
  • David C. Burr
    Department of Psychology, University of Florence, Italy
  • M. Concetta Morrone
    Faculty of Psychology, Universita' Vita-Salute “San Raffaele”, Italy
  • Martin Banks
    School of Optometry and Department of Psychology, University of California Berkeley, USA
Journal of Vision June 2006, Vol.6, 387. doi:https://doi.org/10.1167/6.6.387
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      David C. Burr, M. Concetta Morrone, Martin Banks; Auditory capture of visual stimuli in time is statistically optimal. Journal of Vision 2006;6(6):387. https://doi.org/10.1167/6.6.387.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

The “ventriloquist effect” (mislocalization of sound toward a visual stimulus) is consistent with statistically optimal integration of visual and auditory signals (Alais & Burr, Curr. Biol., 2004). Here we report that “temporal ventriloquism”, the tendency for a sequence of sounds to “capture” visual flashes in time (Shams & Shimojo, Nature, 2000), is also consistent with optimal integration. Subjects performed a temporal-bisection task, reporting whether the second (probe) stimulus in a 3-stimulus (800 ms) sequence was closer in time to the first or third. In single-cue sessions, the three stimuli were all either visual flashes or auditory tones. In two-cue sessions, all stimuli consisted of a flash and tone, presented simultaneously for the second stimulus, but at consistently different times for the first and third stimuli. The perceived point of bisection in the two-cue condition was determined more by tone than flash timing, but both cues influenced the bisection. The results were well predicted from optimal combination of the visual and auditory cues with relative weights derived from the single-cue thresholds. Importantly, bisection thresholds in the two-cue condition were significantly better than in either single-cue condition, strong evidence for inter-modal combination. Further discrimination experiments suggested that combination was not mandatory (Hillis et al., Science, 2002); rather subjects retain access to single-cue information as well as the combined information, calling into question the concept of mandatory temporal binding.

Burr, D. C. Morrone, M. C. Banks, M. (2006). Auditory capture of visual stimuli in time is statistically optimal [Abstract]. Journal of Vision, 6(6):387, 387a, http://journalofvision.org/6/6/387/, doi:10.1167/6.6.387. [CrossRef] [PubMed]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.