September 2018
Volume 18, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2018
Beep, be-, or –ep: The impact of auditory transients on perceived bouncing/streaming.
Author Affiliations
  • Hauke Meyerhoff
    Knowledge Media Research Center, Tuebingen, Germany
  • Satoru Suzuki
    Northwestern University, Evanston, IL, USA
Journal of Vision September 2018, Vol.18, 1138. doi:10.1167/18.10.1138
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Hauke Meyerhoff, Satoru Suzuki; Beep, be-, or –ep: The impact of auditory transients on perceived bouncing/streaming.. Journal of Vision 2018;18(10):1138. doi: 10.1167/18.10.1138.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Establishing object correspondence over time ("Which object went where?") is of central importance for a meaningful interpretation of the surrounding environment. Here, we study auditory contributions to this process using the bouncing/streaming paradigm wherein two discs move toward each other, superimpose, and then move apart. Critically, this event is ambiguous with regard to object correspondence as it is consistent with the interpretation of two discs streaming past each other as well as two discs bouncing off each other. When presented in silence, human observers tend to perceive streaming discs; however, a brief beep that coincides with the moment of visual overlap biases this impression toward bouncing. In four experiments, we tested the hypothesis that this crossmodal interaction is primarily mediated by low-level magnitude-based rather than high-level semantic-based processing. To do so, we orthogonally manipulated the number and semantic category of auditory transients. Specifically, different combinations of onsets and offsets generate qualitatively different events with distinct meanings; a single auditory transient can be a tone onset or a tone offset, and a pair of transients can be a brief tone (onset+offset) or a brief gap (offset+onset). The proportion of seeing bouncing increased with an increasing number of auditory transients (0 vs. 1 vs. 2) regardless of the sound's semantic category. For example, a tone onset and a tone offset were equally effective (relative to no transients), and a brief tone (onset+offset) and a brief gap (offset+onset) were equivalently more effective. We identified a critical window of ± 200 ms around the visual overlap; a longer tone whose offset occurred outside the window was only as effective as a single onset. These results suggest that a simple additive integration of auditory transients within the critical time window primarily mediates the auditory biasing of visual bouncing percepts.

Meeting abstract presented at VSS 2018

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×