October 2020
Volume 20, Issue 11
Open Access
Vision Sciences Society Annual Meeting Abstract  |   October 2020
Failure to account for extrinsic visual noise leads to suboptimal multisensory integration
Author Affiliations & Notes
  • Stacey Aston
    Durham University
  • Cat Pattie
    Newcastle University
  • Ulrik Beierholm
    Durham University
  • Marko Nardini
    Durham University
  • Footnotes
    Acknowledgements  This project was funded by the Leverhulme Trust: RPG-2017-097.
Journal of Vision October 2020, Vol.20, 880. doi:https://doi.org/10.1167/jov.20.11.880
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Stacey Aston, Cat Pattie, Ulrik Beierholm, Marko Nardini; Failure to account for extrinsic visual noise leads to suboptimal multisensory integration. Journal of Vision 2020;20(11):880. https://doi.org/10.1167/jov.20.11.880.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Sensory information integration is often near-optimal (reliability-weighted averaging, e.g. Ernst and Banks, 2002, Nature), but recent reports of suboptimality emphasize the need for process models accounting for suboptimal behavior (Rahnev and Denison, 2018, BBS). In a previous study, when combining sensory and prior information, suboptimal behavior was better fit by a model weighting information according to intrinsic noise only (internal to the observer, e.g. sensory noise) rather than one that accounted for both intrinsic and extrinsic noise (external to the observer, e.g. a stochastic cue) (Kiryakova et al., 2019, BioRxiv). We explicitly tested this hypothesis in a sensory cue-combination task. Twenty participants used auditory (400ms white noise burst) and visual (4-dot cloud) cues to find a hidden virtual object. Dots were drawn from one of two Gaussian distributions and centered on the true location (low/high variance intrinsic-only cues). Error distributions for visual cue-only trials were used for participant-by-participant calibration, where we added extrinsic noise to the low variance condition (shifting the dot cloud) such that intrinsic+extrinsic and intrinsic-only cues were equally reliable. Our hypothesis predicts near-optimal behavior in intrinsic-only trials but suboptimal behavior in intrinsic+extrinsic trials. We tested this by comparing the weight placed on visual cues (obtained by regressing visual bias against visual-auditory conflict) to the optimal prediction (based on single cue performance). Weight placed on the intrinsic-only cue did not differ significantly from optimal (p = .351). Weight placed on the intrinsic+extrinsic cue was significantly higher than optimal (p < .001), but significantly lower than an optimal prediction that ignored extrinsic noise (p = .014). Our results show that under-accounting for extrinsic noise can cause suboptimal perception and decision-making. Human perceptual systems may be well equipped to account for intrinsic uncertainty, but accounting for extrinsic uncertainty is more challenging, possibly in part because this uncertainty must be learned.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.