June 2006
Volume 6, Issue 6
Free
Vision Sciences Society Annual Meeting Abstract  |   June 2006
Classification of natural scenes: Critical features revisited
Author Affiliations
  • Jan Drewes
    University of Giessen, Giessen, Germany
  • Felix A. Wichmann
    Max Planck Institute for Biological Cybernetics, Tübingen, Germany
  • Karl R. Gegenfurtner
    University of Giessen, Giessen, Germany
Journal of Vision June 2006, Vol.6, 561. doi:10.1167/6.6.561
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Jan Drewes, Felix A. Wichmann, Karl R. Gegenfurtner; Classification of natural scenes: Critical features revisited. Journal of Vision 2006;6(6):561. doi: 10.1167/6.6.561.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Human observers are capable of detecting animals within novel natural scenes with remarkable speed and accuracy. Despite the seeming complexity of such decisions it has been hypothesized that a simple global image feature, the relative abundance of high spatial frequencies at certain orientations, could underly such fast image classification (A. Torralba & A. Oliva, Network: Comput. Neural Syst., 2003).

We successfully used linear discriminant analysis to classify a set of 11.000 images into “animal” and “non-animal” images based on their individual amplitude spectra only (Drewes, Wichmann, Gegenfurtner VSS 2005). We proceeded to sort the images based on the performance of our classifier, retaining only the best and worst classified 400 images (“best animals”, “best distractors” and “worst animals”, “worst distractors”).

We used a Go/No-go paradigm to evaluate human performance on this subset of our images. Both reaction time and proportion of correctly classified images showed a significant effect of classification difficulty. Images more easily classified by our algorithm were also classified faster and better by humans, as predicted by the Torralba & Oliva hypothesis.

We then equated the amplitude spectra of the 400 images, which, by design, reduced algorithmic performance to chance whereas human performance was only slightly reduced (cf. Wichmann, Rosas, Gegenfurtner, VSS 2005). Most importantly, the same images as before were still classified better and faster, suggesting that even in the original condition features other than specifics of the amplitude spectrum made particular images easy to classify, clearly at odds with the Torralba & Oliva hypothesis.

Drewes, J. Wichmann, F. A. Gegenfurtner, K. R. (2006). Classification of natural scenes: Critical features revisited [Abstract]. Journal of Vision, 6(6):561, 561a, http://journalofvision.org/6/6/561/, doi:10.1167/6.6.561. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×