August 2010
Volume 10, Issue 7
Vision Sciences Society Annual Meeting Abstract  |   August 2010
Influence of asynchrony on the perception of visual-haptic compliance
Author Affiliations
  • Massimiliano Di Luca
    Max Planck Institute for Biological Cybernetics
  • Benjamin Knörlein
    Computer Vision Laboratory ETH Zurich
  • Matthias Harders
    Computer Vision Laboratory ETH Zurich
  • Marc Ernst
    Max Planck Institute for Biological Cybernetics
Journal of Vision August 2010, Vol.10, 852. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Massimiliano Di Luca, Benjamin Knörlein, Matthias Harders, Marc Ernst; Influence of asynchrony on the perception of visual-haptic compliance. Journal of Vision 2010;10(7):852.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Compliance of deformable materials is perceived through signals about resistive force and displacement. During visual-haptic interactions, visual and proprioceptive signals about material displacement are combined over time with the force signal. Here we asked whether multisensory compliance perception is affected by the timing of signals by introducing an asynchrony between the participant's movement (sensed proprioceptively) and force information or visual information. Visual-proprioceptive asynchronies are obtained by making participants see a delayed video of their haptic interaction with an object rather than the real interaction. Force-proprioceptive asynchronies are instead obtained by making participants compress a virtual object with their hand and sense the resistive force generated by a force feedback device.

Results indicate that force-proprioceptive asynchronies can significantly alter the perception of object stiffness. Moreover, we find that perceived compliance changes also as a function of the delay of visual information. These effects of asynchrony on perceived compliance would not be present if all force-displacement information would be utilized equally over time, as both delays generate a bias in compliance which is opposite in the compression and release phases of the interaction. To explain these findings we hypothesized instead that information during object compression is weighted more than information obtained during object release and that visual and proprioceptive information about the hand position are used for compliance perception depending on the relative reliability of the estimate obtained. We confirm these hypotheses by showing that sensitivity to compliance is much higher during object compression and that degradation of visual and proprioceptive information can modify the weights assigned to the two sources. Moreover, by analyzing participants' movements and feedback forces we show that the two hypothesized factors (compression-release and visual-proprioceptive reliability) can account for the change in perceived compliance due to force-proprioceptive and force-displacement asynchronies.

Di Luca, M. Knörlein, B. Harders, M. Ernst, M. (2010). Influence of asynchrony on the perception of visual-haptic compliance [Abstract]. Journal of Vision, 10(7):852, 852a,, doi:10.1167/10.7.852. [CrossRef]
 This work has been supported by the EU project Immersence IST-2006-27141 and the SNSF and it was performed within the frame of NCCR Co-Me.

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.