October 2003
Volume 3, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   October 2003
Learning to fuse unrelated cues
Author Affiliations
  • Marc O Ernst
    Max-Planck-Institut für biologische Kybernetik, Tübingen, Germany
  • Frank Jäkel
    Graduate School of Neural & Behavioural Sciences, Tübingen, Germany
Journal of Vision October 2003, Vol.3, 32. doi:https://doi.org/10.1167/3.9.32
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Marc O Ernst, Frank Jäkel; Learning to fuse unrelated cues. Journal of Vision 2003;3(9):32. https://doi.org/10.1167/3.9.32.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Humans integrate visual and haptic size information in a statistically optimal fashion (Ernst & Banks, 2002). That is, the perceived size is a weighted average of the individual estimates with weights proportional to their inverse variances. More importantly, the fused percept has lower variance then each individual estimate. Fusion of visual and haptic size estimates is reasonable because in the natural environment these cues to an object's size are highly correlated. The purpose of this study is to investigate whether cue fusion is learned based on the correlation between cues. Therefore, we took naturally uncorrelated cues — the luminance of an object (visual cue) and its stiffness (haptic cue) — and trained 6 subjects for approximately one hour in an environment where these cues were correlated. To test whether training had an effect we compared subject's discrimination performance before and after training for two intermixed conditions: One condition in which the two cues were consistent with the correlation during training (congruent) and the other condition in which the two cues were anti-correlated relative to the training phase (incongruent). If training had an effect we would predict that the stimuli with congruent cues elicit an improvement in discrimination performance relative to the incongruent condition, because if the cues are fused after training the variance of the combined estimate should get lower. In agreement with our prediction we found a significant interaction between pre- and post-test for the two congruent and incongruent conditions (F[1,5]=20,3; p<0.01). This indicates that subjects indeed picked up the correlation in the training phase and fused the two cues. We conclude that fusion of cues can be learned on a relatively short timeframe based on the statistics of their co-occurrence.

Ernst, M. O., Jäkel, F.(2003). Learning to fuse unrelated cues [Abstract]. Journal of Vision, 3( 9): 32, 32a, http://journalofvision.org/3/9/32/, doi:10.1167/3.9.32. [CrossRef] [PubMed]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.