September 2005
Volume 5, Issue 8
Vision Sciences Society Annual Meeting Abstract  |   September 2005
The ventriloquist illusion as an optimal percept
Author Affiliations
  • Ulrik R. Beierholm
    California Institute of Technology, Computation and Neural Systems, 1200 E California #139-74, Pasadena, California 91125
  • Steven R. Quartz
    California Institute of Technology, Computation and Neural Systems, 1200 E California #139-74, Pasadena, California 91125
  • Ladan Shams
    Department of Psychology, University of California, Los Angeles, Franz Hall 7445B, Los Angeles, California 90095-1563
Journal of Vision September 2005, Vol.5, 647. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Ulrik R. Beierholm, Steven R. Quartz, Ladan Shams; The ventriloquist illusion as an optimal percept. Journal of Vision 2005;5(8):647. doi:

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Human perception is highly multisensory. In nature several sources can be the cause of the stimuli and the nervous system has to decide in which cases the inputs received are from a single or multiple sources. This presents the nervous system with the constant problem of deciding which signals should be integrated and how, and which signals should be segregated. We investigated this question in the context of the so-called ventriloquist illusion, by which a ventriloquist can induce the perception of the sound being projected by a puppet by moving the puppet in synchrony with the sound. Depending on the angular separation of the visual and auditory sources, the percept can either be of two different causes (puppet moving, sound from ventriloquist) or a single one (puppet talking). It has been previously shown that an ideal observer model of multisensory processing derived from Bayesian inference can account for the sound-induced flash illusion and the general task of reporting number of pulsations which is primarily a temporal task. We examined whether this model can explain the ventriloquist illusion which involves a spatial task. We presented subjects with flashes of gabor wavelets on a noisy background accompanied by brief bursts of auditory noise. The visual stimulus and auditory stimulus were presented at the same or different locations, each at one of 5 locations along a horizontal line. The task was to indicate the location of the visual stimulus as well as that of the auditory stimulus in each trial. The subjects' auditory and visual responses were surprisingly consistent with the ideal observer in all conditions (R2=0.91). The finding that the Bayesian inference model can account for auditory-visual integration/segregation in two complementary tasks and paradigms suggests that Bayesian inference is a general principle governing multisensory information processing in humans, spanning situations of segregation to partial interaction to complete fusion.

Beierholm, U. R. Quartz, S. R. Shams, L. (2005). The ventriloquist illusion as an optimal percept [Abstract]. Journal of Vision, 5(8):647, 647a,, doi:10.1167/5.8.647. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.