August 2010
Volume 10, Issue 7
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2010
Visual cortex represents the statistical distributions of objects in natural scenes
Author Affiliations
  • Dustin Stansbury
    Vision Science, University of California, Berkeley
  • Thomas Naselaris
    Helen Wills Neuroscience Institute, University of California, Berkeley
  • An Vu
    Bioengineering, University of California, Berkeley
  • Jack Gallant
    Vision Science, University of California, Berkeley
    Helen Wills Neuroscience Institute, University of California, Berkeley
    Bioengineering, University of California, Berkeley
    Psychology, University of California, Berkeley
Journal of Vision August 2010, Vol.10, 1260. doi:https://doi.org/10.1167/10.7.1260
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Dustin Stansbury, Thomas Naselaris, An Vu, Jack Gallant; Visual cortex represents the statistical distributions of objects in natural scenes. Journal of Vision 2010;10(7):1260. https://doi.org/10.1167/10.7.1260.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Natural scenes are comprised of collections of objects with specific types of objects tending to occur in certain classes of scenes. We hypothesize that the visual system might exploit these co-occurrence statistics in order to classify scenes more efficiently. If this is true, then a model that captures the distribution of objects in natural scenes should provide good predictions of visual cortical activity during natural vision. To construct such a model we adapted a recent probabilistic algorithm known as Latent Dirichlet Allocation (LDA). Given thousands of object-labeled natural images, LDA analyzes the label co-occurrences and ‘learns’ the distribution of objects in various scene classes. (The number of scene classes is a free parameter determined by the modeler; the specific scene classes are latent states learned by LDA). We then presented thousands of natural scenes to subjects while recording fMRI-BOLD activity in retinotopic and object-selective visual cortex. Afterwards, we estimated the scene-specific selectivity of all recorded voxels by regressing the BOLD responses evoked by each image onto the scene classes provided by LDA. We find that specific regions within lateral and ventral occipital-temporal areas are selective for various specific classes of natural scenes. (This is consistent with previous results; Naselaris et al. 2009). Selectivities, as determined by our method, are generally consistent with selectivities defined by standard functional localizers. However, we also find scene selectivity in many areas that are not identified by standard functional localizers. Finally, in order to determine how many distinct scene classes might be represented in anterior visual cortex, we varied the number of scene classes learned by LDA. The best model descriptions were obtained when the model learned 8-18 scene classes. In summary, our results suggest that regions within occipital-temporal visual cortex represent the distribution of objects in certain specific categories of natural scenes.

Stansbury, D. Naselaris, T. Vu, A. Gallant, J. (2010). Visual cortex represents the statistical distributions of objects in natural scenes [Abstract]. Journal of Vision, 10(7):1260, 1260a, http://www.journalofvision.org/content/10/7/1260, doi:10.1167/10.7.1260. [CrossRef]
Footnotes
 NEI.
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×