June 2004
Volume 4, Issue 8
Vision Sciences Society Annual Meeting Abstract  |   August 2004
Significant audio-visual interaction for spatially congruent stimuli
Author Affiliations
  • Patricia A. Neil
    Computation and Neural Systems, California Institute of Technology, USA
  • Aman Chawla
    Dept of Electrical & Computer Eng., Cornell University, Itacha, NY, USA
    Division of Biology, CalTech, USA
  • Joydeep Bhattacharya
    Division of Biology, CalTech, USA
    Comm. for Scientific Visualization, Austrian Academy of Sciences, Vienna, Austria
  • Shinsuke Shimojo
    Division of Biology, CalTech, USA
    NTT Lab, Atsugi, Japan
Journal of Vision August 2004, Vol.4, 702. doi:https://doi.org/10.1167/4.8.702
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Patricia A. Neil, Aman Chawla, Joydeep Bhattacharya, Shinsuke Shimojo; Significant audio-visual interaction for spatially congruent stimuli. Journal of Vision 2004;4(8):702. https://doi.org/10.1167/4.8.702.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Studies on auditory and visual interactions encompass a wide range of tasks and methodologies. Direct comparison of different studies is often difficult when the stimuli, tasks, and analytical approach differ. Animal studies have shown that spatially and temporally congruent visual and auditory stimuli produce an enhanced neural response in multisensory neurons of the superior colliculus, whereas incongruent stimuli produce either a suppressed or unchanged response. A similar behavioral response has been found in humans; congruent visual and auditory stimuli produce reduced response latencies in target localization. Most audiovisual research has focused on temporal properties and arbitrary or learned connections. We investigated the role of spatial congruency in multisensory interaction in adult human subjects (n=11) using both behavioral and multi-channel EEG signal recordings. Subjects were asked to saccade toward a target presented at +/− 25 or 45 deg, while their eye movements and cortical activity were recorded. The target was either a vertical red line (V), a short burst of white noise (A), or both at congruent (AVc) or incongruent (AVi) locations. Interaction was studied by comparing the response latencies and event-related potential (ERP) responses toward A and V targets with their AV counterparts. The results revealed strong audio-visual interaction with earliest onset latency of 150 ms for spatially congruent stimuli with a correspondingly shorter response latency, but were inconsistent for spatially incongruent stimuli. Although many cortical regions showed temporally sustained interaction, the earliest effect was found in anterior frontal regions, perhaps influencing sensory-specific areas through feedback projections. These results demonstrate that spatial coincidence can significantly modulate the neuronal information processing in the modality-specific regions, thus mediating multisensory interaction and the overt behavioral response.

Neil, P. A., Chawla, A., Bhattacharya, J., Shimojo, S.(2004). Significant audio-visual interaction for spatially congruent stimuli [Abstract]. Journal of Vision, 4( 8): 702, 702a, http://journalofvision.org/4/8/702/, doi:10.1167/4.8.702. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.