September 2015
Volume 15, Issue 12
Vision Sciences Society Annual Meeting Abstract  |   September 2015
Correlation detection as a general mechanism for multisensory integration
Author Affiliations
  • Cesare Parise
    University of Bielefeld
  • Marc Ernst
    University of Bielefeld
Journal of Vision September 2015, Vol.15, 364. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Cesare Parise, Marc Ernst; Correlation detection as a general mechanism for multisensory integration. Journal of Vision 2015;15(12):364.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

To better interact with their surrounding, all animals are equipped with multiple sensory systems to redundantly perceive their body and the world around them. Over the last decade, a number of studies have demonstrated that, by selectively combining related information across the continuous stream of sensory inputs, the nervous system is able to integrate multisensory cues in a statistically optimal fashion. However, the fundamental question of how the brain selects which signals to combine, that is, how it solves the correspondence problem, is still waiting for a proper explanation. Here we propose and validate a biologically plausible, multi-purpose model for multisensory correlation detection. Such a model can solve the correspondence problem, perform optimal cue integration, and detect both correlations and lags across multiple sensory signals. The model could tightly replicate human performance in a variety of both novel and previously published psychophysical tasks. The present results provide for the first time a unique general explanation for a number of key aspects of multisensory perception, such as optimal cue integration, breakdown of integration, and the detection of correlation, lag, and synchrony across the senses.

Meeting abstract presented at VSS 2015


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.