July 2013
Volume 13, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   July 2013
Changing pitch modulates motion-direction information in V1
Author Affiliations
  • Won Mok Shim
    Psychological and Brain Sciences, Dartmouth College
  • Stefan Uddenberg
    Psychological and Brain Sciences, Dartmouth College
  • Yune-Sang Lee
    Center for Cognitive Neuroscience, University of Pennsylvania
Journal of Vision July 2013, Vol.13, 617. doi:https://doi.org/10.1167/13.9.617
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Won Mok Shim, Stefan Uddenberg, Yune-Sang Lee; Changing pitch modulates motion-direction information in V1. Journal of Vision 2013;13(9):617. https://doi.org/10.1167/13.9.617.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Although the sight and sound of objects were thought to be encoded initially via separate visual and auditory pathways, then combined later in high-level multisensory areas, there is growing evidence that multisensory processing also occurs in early modality-specific sensory cortices. However, it remains unclear how uni-modal sensory information in the early sensory cortex is influenced by information from other senses when the association between information from different modalities is abstract in nature, without natural spatiotemporal correspondence. In order to address this question, using fMRI and multi-voxel pattern analysis, we examine whether motion direction information in V1 is modulated when a moving stimulus is presented with a changing pitch that is congruent or incongruent with respect to the direction of visual motion. Random dots moving either upward or downward in a circular annulus were presented with an ascending or descending pitch. While fixating at the center, subjects monitored random dots for occasional changes in their motion direction. The motion direction of random dots was successfully decoded in V1 when the direction of visual motion and changing pitch were congruent (e.g., ascending pitch and upward motion or descending pitch and downward motion), but decoding accuracy significantly decreased when they were incongruent. These findings suggest that visual motion information in the early visual cortex is modulated by concurrently present auditory information, even when their association is only "metaphoric."

Meeting abstract presented at VSS 2013


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.