August 2010
Volume 10, Issue 7
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2010
A computational model for change detection in familiar environments
Author Affiliations
  • Dmitry Kit
    University of Texas at Austin
  • Brian Sullivan
    University of Texas at Austin
  • Kat Snyder
    University of Texas at Austin
Journal of Vision August 2010, Vol.10, 743. doi:10.1167/10.7.743
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Dmitry Kit, Brian Sullivan, Kat Snyder; A computational model for change detection in familiar environments. Journal of Vision 2010;10(7):743. doi: 10.1167/10.7.743.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Detecting visual changes in environments is an important computation that has applications both in the study of human and computer vision. Additionally, task oriented descriptions of visual cognition [1] could use such a mechanism for switching between ongoing tasks and updating internal visuospatial memory representations. We conjecture that the number of environments in which people spend most of their time is limited (out of the set of possible visual stimuli), that the environments do not frequently undergo major changes between observations and that over time subjects learn distributions of spatial and visual features. These assumptions can be exploited to reduce computational complexity of processing visual information by utilizing memory to store previous computations. A change detection technique is then required to detect when predictions deviate from reality. Baldi and Itti [2] provided a Bayesian technique, however they did not incorporate spatial location of features and require a commitment to a distribution of features a priori. We propose a mechanism that instead uses a low dimensional representation of visual features to generate predictions for ongoing visual stimuli. Deviations from these predictions can be rapidly detected and could be used as a reorienting attentional signal. The model we present is computationally fast and uses a compact descriptions of complex visual stimuli. Specifically, the model encodes color histograms of naturalistic visual scenes captured while exploring an environment. It learns a spatial layout of visual features using a self-organizing map on location data and color data, compressed using the matching pursuit algorithm. We present tests of the model on detecting changes in a virtual environment, and preliminary data for human subjects' change detection in the same environment.

[1] Sprague and Ballard, Proceedings of the 18th IJCAI, August 2003

[2] Baldi and Itti, ICNN&B 2005.

Kit, D. Sullivan, B. Snyder, K. (2010). A computational model for change detection in familiar environments [Abstract]. Journal of Vision, 10(7):743, 743a, http://www.journalofvision.org/content/10/7/743, doi:10.1167/10.7.743. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×