July 2019
Volume 19, Issue 8
Open Access
OSA Fall Vision Meeting Abstract  |   July 2019
Motion parallax improves recognition of new objects presented in clutter in simulated prosthetic vision
Author Affiliations
  • Kassandra R. Lee
    Department of Psychology, University of Nevada, Reno
  • Cheng Qiu
    Department of Psychology, University of Pennsylvania
  • Jae-Hyun Jung
    Department of Ophthalmology, Harvard Medical School
  • Eli Peli
    Department of Ophthalmology, Harvard Medical School
Journal of Vision July 2019, Vol.19, 102. doi:https://doi.org/10.1167/19.8.102
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Kassandra R. Lee, Cheng Qiu, Jae-Hyun Jung, Eli Peli; Motion parallax improves recognition of new objects presented in clutter in simulated prosthetic vision. Journal of Vision 2019;19(8):102. doi: https://doi.org/10.1167/19.8.102.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Purpose: Efficacy of current visual prostheses for object recognition is limited. Various limitations such as low resolution and low dynamic range need to be addressed, but here we focus on reducing the impact of background clutter on object recognition. We have proposed the use of motion parallax via lateral scanning with head-mounted camera and computational stabilization of the object of interest (OI) to support background decluttering. We used head-mounted display (HMD) simulations to mimic the proposed effect and test object recognition in normally-sighted subjects.

Methods: Images (24° field of view) were captured at multiple viewpoints, always centered on the OI, and presented in low resolution (20×20). Experimental conditions (2×3) included: clutter (with or without) × head scanning (single viewpoint, nine coherent viewpoints corresponding to subjects’ head positions, and nine randomly presented viewpoints). Subjects utilized lateral head movements to view OIs on the HMD. Each object was displayed only once for each subject.

Results: The median recognition rate without clutter was 40% for all head scanning conditions. With clutter, performance dropped to 10% in the static condition, but was improved to 20% in the coherent and random head scanning conditions (corrected p = 0.005 and p = 0.049, respectively).

Conclusions: Background decluttering using motion parallax cues and not the coherent multiple views of the OI improved object recognition in low-resolution images. This method did not fully eliminate background impact on recognition.

Motion parallax is an effective but incomplete decluttering solution for object recognition with visual prostheses.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.