June 2007
Volume 7, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   June 2007
Beyond pair-wise statistics in visual scene perception
Author Affiliations
  • József Fiser
    Volen Center for Complex Systems, Brandeis University, and Department of Psychology, Brandeis University
  • Gergõ Orbán
    Volen Center for Complex Systems, Brandeis University
  • Richard Aslin
    Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester
  • Máté Lengyel
    Gatsby Computational Neuroscience Unit University College London, UK
Journal of Vision June 2007, Vol.7, 799. doi:https://doi.org/10.1167/7.9.799
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      József Fiser, Gergõ Orbán, Richard Aslin, Máté Lengyel; Beyond pair-wise statistics in visual scene perception. Journal of Vision 2007;7(9):799. https://doi.org/10.1167/7.9.799.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

The dominant view on how humans develop new visual representations is based on the paradigm of iterative associative learning. According to this account, new features are developed based on the strength of the pair-wise correlations between sub-elements, and complex features are learned by recursively associating already obtained features. In addition, Hebbian mechanisms of synaptic plasticity seem to provide a natural neural substrate for associative learning. However, this account has two major shortcomings. First, in associative learning, even the most complex features are extracted solely on the basis of pair-wise correlations between their sub-elements, while it is conceivable that there are features for which higher order statistics are necessary to learn. Second, learning about all pair-wise correlations can already be intractable since the storage requirement for such representations grows exponentially with the number of elements in a scene, and learning progressively higher order statistics only exacerbates this combinatorial explosion. We present the results of a series of experiments that assessed how humans learn about higher-order statistics. We found that learning in an unsupervised visual task is above chance even when pair-wise statistics contain no relevant information. We implemented a formal normative model of learning to group elements into features based on statistical contingencies using Bayesian model comparison, and demonstrate that humans perform close to Bayes-optimal. Although the computational requirements of learning based on model comparison are considerable, they are not incompatible with Hebbian plasticity, and offer a principled solution to the storage-requirement problem by generating optimally economical representations. The close fit of the model to human performance in a large set of experiments suggests that humans learn new complex information by generating the simplest sufficient representation based on previous experience and not by encoding the full correlational structure of the input.

Fiser, J. Orbán, G. Aslin, R. Lengyel, M. (2007). Beyond pair-wise statistics in visual scene perception [Abstract]. Journal of Vision, 7(9):799, 799a, http://journalofvision.org/7/9/799/, doi:10.1167/7.9.799. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.