August 2010
Volume 10, Issue 7
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2010
Formal congruency and spatiotemporal proximity in multisensory integration
Author Affiliations
  • Elena Makovac
    Department of Psychology “Gaetano Kanizsa”, University of Trieste, Italy
  • Walter Gerbino
    Department of Psychology “Gaetano Kanizsa”, University of Trieste, Italy
Journal of Vision August 2010, Vol.10, 862. doi:https://doi.org/10.1167/10.7.862
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Elena Makovac, Walter Gerbino; Formal congruency and spatiotemporal proximity in multisensory integration. Journal of Vision 2010;10(7):862. https://doi.org/10.1167/10.7.862.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Makovac & Gerbino (2009 a, b) reported increases of the multisensory response enhancement (MRE) when audiovisual AV components of a cross-modal event are (a) formally congruent, like in the takete-maluma phenomenon, and (b) in close spatiotemporal proximity, a necessary condition for multisensory integration by the superior colliculus and other brain areas (Calvert et al. 2000). While previous studies required observers to explicitly evaluate target properties, our MRE effects were obtained by asking observers to detect the occurrence of V targets and to ignore sounds, in either A and AV trials. Data were consistent with general principles of multisensory integration (spatial rule, temporal rule, inverse effectiveness rule).

In the present research we utilized a combination of implicit tasks to study three aspects of MRE effects: (1) the interaction between the structural components of cross-modal stimulation, formal congruency and spatiotemporal proximity; (2) the optimal AV asynchrony compatible with low-efficiency stimuli; (3) the relationship between superadditivity and automatic activation as criteria for defining multisensory integration. Formal congruency was manipulated by varying the degree of similarity between the sound intensity profile and the 2D visual shape of short (<100 ms) AV events. The optimal (i.e., inducing a maximum MRE) stimulus onset asynchrony was compared to perceived simultaneity of AV stimuli for each observer, measured in a control condition. Superadditivity was evaluated by comparing the estimates of top performances in unisensory and multisensory sessions. We discuss our results in the context of current psychophysical and fMRI evidence on formal (Gallace & Spence 2006), semantic (Hein et al. 2007), and training-induced (Naumer et al. 2008) congruency effects in AV object representation.

Makovac, E. Gerbino, W. (2010). Formal congruency and spatiotemporal proximity in multisensory integration [Abstract]. Journal of Vision, 10(7):862, 862a, http://www.journalofvision.org/content/10/7/862, doi:10.1167/10.7.862. [CrossRef]
Footnotes
 MS01_00006 grant (Industry 2015).
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×