June 2004
Volume 4, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2004
Saliency, objects and scenes: global scene factors in attention and object detection
Author Affiliations
  • Antonio Torralba
    Computer Science and Artificial Intelligence Laboratory, MIT, USA
  • Aude Oliva
    Department of Psychology, Cognitive Science Program, MSU, USA
  • Monica S. Castelhano
    Department of Psychology, Cognitive Science Program, MSU, USA
  • John M. Henderson
    Department of Psychology, Cognitive Science Program, MSU, USA
Journal of Vision August 2004, Vol.4, 337. doi:10.1167/4.8.337
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to Subscribers Only
      Sign In or Create an Account ×
    • Get Citation

      Antonio Torralba, Aude Oliva, Monica S. Castelhano, John M. Henderson; Saliency, objects and scenes: global scene factors in attention and object detection. Journal of Vision 2004;4(8):337. doi: 10.1167/4.8.337.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

In this work we describe a general probabilistic framework that accounts for deployment of attention in complex natural images, scene recognition and object detection. The framework integrates into a unique model three factors for attention guidance (Torralba 2003; Oliva, Torralba, Castelhano, Henderson 2003): bottom-up saliency (based on low-level image properties), target driven search (model of the appearance of the target object) and global scene priors (top-down priors provided by the gist of the scene). Using a Bayesian framework, we show how to determine (1) which are the locations and scales in the image that are best candidates to contain objects of interest, (2) how the expected appearance of the target modulates the saliency of local image regions and, (3) scene priors: used to modulate the saliency of image regions early during the visual search task. The Bayesian model can be used to study different tasks by marginalizing with respect to the irrelevant variables: I) object detection (two forced choice task: is the target present in the image?) by marginalizing with respect to location. II) Object localization (visual search task), and III) Scene exploration (free viewing of an image) by marginalizing with respect to all the object classes. We study how each factor of the model (saliency, object model and scene priors) contributes to explaining subject performance in each task.

Torralba, A., Oliva, A., Castelhano, M. S., Henderson, J. M.(2004). Saliency, objects and scenes: global scene factors in attention and object detection [Abstract]. Journal of Vision, 4( 8): 337, 337a, http://journalofvision.org/4/8/337/, doi:10.1167/4.8.337. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×