September 2021
Volume 21, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2021
Spatial extent of audiovisual cross-modal attention
Author Affiliations & Notes
  • Satoshi Shioiri
    Tohoku University
  • Shin Ono
    Tohoku University
  • Wei Wei
    Tohoku University
  • Shuichi Sakamoto
    Tohoku University
  • Ryo Teraoka
    Tohoku University
  • Yoshiyuki Sato
    Illinois State University, Department of Psychology
  • Yasuhiro Hatori
    Tohoku University
  • Chia-huei Tseng
    Tohoku University
  • Ichiro Kuriki
    Tohoku University
  • Footnotes
    Acknowledgements  KAKENHI 19H01111
Journal of Vision September 2021, Vol.21, 2189. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Satoshi Shioiri, Shin Ono, Wei Wei, Shuichi Sakamoto, Ryo Teraoka, Yoshiyuki Sato, Yasuhiro Hatori, Chia-huei Tseng, Ichiro Kuriki; Spatial extent of audiovisual cross-modal attention. Journal of Vision 2021;21(9):2189.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

[Introduction] Effect of the audiovisual cross-modal attention, e.g., facilitation of auditory processing at the location attended visually, has been reported. To understand the underlying mechanism of such audiovisual attention, we estimated the spatial distribution of attentional modulation for visual and auditory processing around the focus of either visual or auditory attentions. [Methods] We measured attentional modulation in visual/auditory processing at 11 stimulus locations along a horizontal line, using a technique with Steady State Responses (SSRs) of electroencephalogram signals. At each of the 11 locations, a letter on a flickering disc was displayed and a loudspeaker was installed for sounds with amplitude modulations for the purpose of SSR measurements. Different temporal frequencies were assigned to the luminance flicker and amplitude modulation at different locations. The SSRs were extracted based on the temporal frequency tagged to each location, based on which we estimated distribution of attentional modulation around the focus of either visual or auditory attentions. Participants paid attention to a location indicated for detecting the target (i.e., A) in sequences of simultaneously presentations of vowel letters and vowel sounds (rapid serial bimodal presentations of A, E, I, O, U) at the location. The letters and sounds were presented also at the other locations to check false responses. [Results] The results showed that visual attention influences auditory responses. Contrary to the prediction, the influence of visual attention on the auditory response was suppression, rather than facilitation, and the influence was found in the area that visual attention covered. The auditory attention, instead, did not show statistically significantly effect on the visual responses, while the SSR amplitude for visual stimuli were larger around the focus of auditory attention than the other locations. [Conclusion] We conclude that there is common attention process with a spatial representation that integrates visual and auditory signals.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.