May 2008
Volume 8, Issue 6
Free
Vision Sciences Society Annual Meeting Abstract  |   May 2008
Decoding of natural scene categories from transformed images using distributed patterns of fMRI activity
Author Affiliations
  • Eamon Caddigan
    Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, and Department of Psychology, University of Illinois at Urbana-Champaign
  • Dirk Walther
    Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign
  • Li Fei-Fei
    Department of Computer Science, Princeton University
  • Diane Beck
    Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, and Department of Psychology, University of Illinois at Urbana-Champaign
Journal of Vision May 2008, Vol.8, 330. doi:https://doi.org/10.1167/8.6.330
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Eamon Caddigan, Dirk Walther, Li Fei-Fei, Diane Beck; Decoding of natural scene categories from transformed images using distributed patterns of fMRI activity. Journal of Vision 2008;8(6):330. https://doi.org/10.1167/8.6.330.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Human observers are able to quickly and efficiently extract information, such as the “gist,” from images of natural scenes (Potter & Levy, 1969). Previous studies have identified brain regions that respond selectively to images of natural scenes, including the parahippocampal place area (PPA; Epstein & Kanwisher, 1998) and retrosplenial cortex (RSC; O'Craven & Kanwisher, 2000). However, it is not known to what extent these place-selective regions participate in the categorization of natural scenes. As a means of testing for the presence of scene-category information in these regions, we used fMRI and statistical pattern recognition algorithms (Cox & Savoy, 2003) to identify distributed patterns of activity associated with natural scene categories (beaches, mountains, forests, tall buildings, highways, and industrial scenes). In our first experiment, fMRI data was aquired while subjects passively viewed 60 images from each of six categories, in 6 blocks of 10 images each of the same category, organized into 12 runs during which images were displayed upright or inverted on alternating runs. In a leave-one-run-out (LORO) cross-validation procedure, we found that statistical pattern recognition algorithms were able to predict the categories of the scene viewed by the participants at rates significantly above chance using voxels in retinotopic cortex or the PPA. Using a more sensitive classifier than reported last year, we found a significant inversion effect in both PPA and retinotopic cortex: i.e. training on upright and testing on inverted resulted in a decrement in performance relative to testing on new upright images. A subsequent experiment used a similar design, with alternating runs consisting of sequences of large and small images. Above-chance classification rates were obtained in the PPA, with a decrease in accuracy for small scene images vs. large images. These results suggest that the PPA is sensitive to changes in image size and orientation.

Caddigan, E. Walther, D. Fei-Fei, L. Beck, D. (2008). Decoding of natural scene categories from transformed images using distributed patterns of fMRI activity [Abstract]. Journal of Vision, 8(6):330, 330a, http://journalofvision.org/8/6/330/, doi:10.1167/8.6.330. [CrossRef]
Footnotes
 This work was supported by the UIUC Critical Research Initiative, a Beckman Postdoctoral Fellowship to D.B.W., and a Beckman Predoctoral Fellowship to E.C.
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×