September 2005
Volume 5, Issue 8
Vision Sciences Society Annual Meeting Abstract  |   September 2005
Neural correlates of coherent audio-visual motion perception
Author Affiliations
  • Oliver Baumann
    Insitute of Experimental Psychology, University of Regensburg, Germany
  • Mark W. Greenlee
    Insitute of Experimental Psychology, University of Regensburg, Germany
Journal of Vision September 2005, Vol.5, 648. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Oliver Baumann, Mark W. Greenlee; Neural correlates of coherent audio-visual motion perception. Journal of Vision 2005;5(8):648. doi:

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Moving objects in a cluttered scene are often detected by multisensory cues. We investigated the cortical activations associated with coherent visual motion perception in the presence of a stationary or moving sound source. Subjects (n = 12) judged 5s-episodes of random-dot motion containing either no (0%), meager (3%) or abundant (16%) coherent visual direction information. Simultaneous auditory noise was presented via MR-compatible headphones with an in-phase moving, out-of-phase moving or stationary sound source (simulated with generic head-related transfer function). In a 4AFC response paradigm, subjects judged whether visual coherent motion was present, and if so, whether the auditory sound source was moving in-phase with the visual motion, was moving out-of-phase or was not moving. Threshold-level performance was achieved by all subjects at the 3% visual coherence level, and the false alarm rate remained below 20%. T2*-weighted images were acquired using a 1.5 T Siemens Sonata with an 8-channel phase-array headcoil, and fixation was monitored with the MR-Eyetracker (CRS Ltd). To eliminate interference with the noises created by the gradient system (with headphone dampening, 80 db), a sparse imaging, whole-brain (36 slices) design was employed with TR = 3.4 s and inter-acquisition breaks of 11.6 s. An SPM2 fixed-effects analysis revealed significant BOLD clusters in extrastriate and associational visual cortex that increased in magnitude with visual coherence level. Auditory motion activated an extended region (> 1000 voxels) of the STG, exhibiting a right-hemispheric preponderance. Combined audio-visual motion (contrast: in-phase > static sound) led to significant activations in the supramarginal gyrus and STG, and the resulting effect size was larger for the in-phase than for the out-of-phase condition. Our findings indicate that the lateral parietal and superior temporal cortex underlies our ability to integrate audio-visual motion cues.

Baumann, O. Greenlee, M. W. (2005). Neural correlates of coherent audio-visual motion perception [Abstract]. Journal of Vision, 5(8):648, 648a,, doi:10.1167/5.8.648. [CrossRef]
 Supported by: DFG, SPP1107

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.