August 2023
Volume 23, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   August 2023
Causal inference modulates audiovisual temporal recalibration
Author Affiliations & Notes
  • Luhe Li
    Department of Psychology, New York University
  • Fangfang Hong
    Department of Psychology, New York University
  • Stephanie Badde
    Department of Psychology, Tufts University
  • Michael S. Landy
    Department of Psychology, New York University
    Center for Neural Science, New York University
  • Footnotes
    Acknowledgements  This work was supported by grant NIH EY08266.
Journal of Vision August 2023, Vol.23, 5762. doi:https://doi.org/10.1167/jov.23.9.5762
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Luhe Li, Fangfang Hong, Stephanie Badde, Michael S. Landy; Causal inference modulates audiovisual temporal recalibration. Journal of Vision 2023;23(9):5762. https://doi.org/10.1167/jov.23.9.5762.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Cross-modal recalibration promotes perceptual accuracy by correcting for systematic discrepancies between multisensory cues. Recently, it has been shown that cross-modal spatial recalibration relies on observers’ multisensory percepts, which in turn are guided by causal inference. Causal inference solves the central challenge for human observers to integrate cues from multiple modalities that derive from the same source, but segregate cues from separate sources. Yet, it remains unknown whether this framework generalizes to the temporal domain. We adopted a classical recalibration paradigm composed of a pre-test, an exposure phase, and a post-test repeated across nine sessions. In pre- and post-tests, we measured observers’ perceived audiovisual synchrony: observers indicated the perceived order (“vision first,” “audition first,” or “simultaneous”) of audiovisual stimulus pairs with varying temporal offset. In the exposure phase, observers were exposed in each session to 250 audiovisual stimuli with one of nine fixed temporal offsets that differed in sign and magnitude. In the subsequent post-test, perceived synchrony was shifted in the direction of the temporal offset experienced during the exposure phase. Moreover, the amount of recalibration first increased but then decreased with increasing temporal offset (audio lead or lag) during the exposure phase. This pattern agrees with an involvement of causal inference because temporally distant stimuli are more likely to originate from separate causes and therefore their perceptual estimates should lead to less recalibration. To further test our hypothesis, we fitted several variants of the causal-inference model to the temporal-order judgments as well as a model that assumes recalibration by a constant proportion of the adaptor temporal offset. Model comparison revealed that the majority of observers relied on causal-inference-driven percepts during recalibration, indicating that causal inference plays a key role for multisensory perception in the temporal domain.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×