June 2004
Volume 4, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2004
What is an inter-sensory object? Optimal combination of vision and touch depends on their spatial coincidence
Author Affiliations
  • Sergei Gepshtein
    University of California, Berkeley, CA, USA
  • Johannes Burge
    University of California, Berkeley, CA, USA
  • Martin S. Banks
    University of California, Berkeley, CA, USA
  • Marc O. Ernst
    Max Planck Institute for Biological Cybernetics, Tuebingen, Germany
Journal of Vision August 2004, Vol.4, 140. doi:10.1167/4.8.140
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to Subscribers Only
      Sign In or Create an Account ×
    • Get Citation

      Sergei Gepshtein, Johannes Burge, Martin S. Banks, Marc O. Ernst; What is an inter-sensory object? Optimal combination of vision and touch depends on their spatial coincidence. Journal of Vision 2004;4(8):140. doi: 10.1167/4.8.140.

      Download citation file:


      © 2016 Association for Research in Vision and Ophthalmology.

      ×
  • Supplements
Abstract

Recent work showed that humans combine visual and haptic information about object size in a way that approaches statistical optimality: The precision of combined estimates is higher than with vision or touch alone (Ernst & Banks, 2002; Gepshtein & Banks, 2003). If the brain combines the visual and haptic signals optimally when they appear to come from the same object, the precision of combination should be greater when the signals originate from the same location in space. We examined this by varying the spatial offset between the visual and haptic stimuli. In a 2-IFC procedure, each interval contained visual and haptic stimuli, spatially superimposed or separated by up to 10 cm. The visual stimuli were random-dot stereograms of two parallel surfaces; the haptic stimuli were two parallel surfaces created by force-feedback devices. Observers indicated the interval containing the greater perceived inter-surface distance. The increase in precision with two cues as opposed to one cue should be greatest when visual and haptic weights are equal, so we equated the weights for each observer by finding the surface slant at which vision and haptics were equally precise (Gepshtein & Banks, 2003). We found that inter-modality, just-noticeable differences (JND) for object size grew as a function of spatial separation between the visual and haptic stimuli. With no separation, JNDs were close to optimal. With large separations, JNDs worsened. We examined whether this effect of spatial coincidence is affected by scene layout; for example, when the lack of coincidence is “explained” by occlusion of the haptic stimulus.

Gepshtein, S., Burge, J., Banks, M. S., Ernst, M. O.(2004). What is an inter-sensory object? Optimal combination of vision and touch depends on their spatial coincidence [Abstract]. Journal of Vision, 4( 8): 140, 140a, http://journalofvision.org/4/8/140/, doi:10.1167/4.8.140. [CrossRef]
Footnotes
 Supported by grants from NIH (EY12851) and AFOSR (F49620-01-0417).
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×