June 2006
Volume 6, Issue 6
Vision Sciences Society Annual Meeting Abstract  |   June 2006
Interaction of visual and haptic cues in the image-based perception of depth
Author Affiliations
  • Bing Wu
    Department of Psychology, Carnegie Mellon University, and Robotics Institute, Carnegie Mellon University
  • Roberta L. Klatzky
    Department of Psychology, Carnegie Mellon University, and Human-Computer Interaction Institute, Carnegie Mellon University
  • Damion Shelton
    Robotics Institute, Carnegie Mellon University
  • George Stetten
    Robotics Institute, Carnegie Mellon University, and Department of Biomedical Engineering, University of Pittsburgh
Journal of Vision June 2006, Vol.6, 180. doi:https://doi.org/10.1167/6.6.180
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Bing Wu, Roberta L. Klatzky, Damion Shelton, George Stetten; Interaction of visual and haptic cues in the image-based perception of depth. Journal of Vision 2006;6(6):180. doi: https://doi.org/10.1167/6.6.180.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Many medical applications attempt to locate targets by using imaging techniques such as ultrasound. If the target is located in a compressible medium (e.g., human tissue), however, its position in the ultrasound image will shift as the medium is compressed. We investigated whether users can accommodate to such displacements by using visual and haptic cues and accurately judge target depth. Subjects were asked to locate targets underneath a soft rubber surface. Visual cues to the amount of compression were provided by a grid on the surface that deformed under pressure and by the visible displacement of the tip of the ultrasound probe. The first experiment tested whether these visual cues are sufficient for judging surface deformation and compensating so as to accurately locate the target. Subjects acquired ultrasound images of targets at different depths and localized them with a triangulation-by-pointing procedure. Using conventional ultrasound with a remote display, subjects consistently underestimated surface deformation and thus target depth. In a second experiment, haptic feedback was added so that resisting force increased with surface deformation. We found that the stiffer the surface, the less the underestimation of target depth due to compression. A third experiment used a different imaging display, the Sonic Flashlight, an augmented-reality tool that enables users to directly see the target in 3D space. The perception of target location with this device was accurate despite the surface compliance. An ongoing experiment is further examining the learning and transfer of skills to correct the compliance effect.

Wu, B. Klatzky, R. L. Shelton, D. Stetten, G. (2006). Interaction of visual and haptic cues in the image-based perception of depth [Abstract]. Journal of Vision, 6(6):180, 180a, http://journalofvision.org/6/6/180/, doi:10.1167/6.6.180. [CrossRef]
 Supported by grants from NIH (#R01-EB00860) and NSF (0308096).

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.