August 2009
Volume 9, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2009
Where to look? Dissociating the effect of reward, salience and attention
Author Affiliations
  • Vidhya Navalpakkam
    Division of Biology
  • Christof Koch
    Division of Biology, and Computation and Neural Systems
  • Antonio Rangel
    Computation and Neural Systems, and Division of Humanities and Social Sciences
  • Pietro Perona
    Computation and Neural Systems, and Division of Engineering and Applied Science
Journal of Vision August 2009, Vol.9, 421. doi:10.1167/9.8.421
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to Subscribers Only
      Sign In or Create an Account ×
    • Get Citation

      Vidhya Navalpakkam, Christof Koch, Antonio Rangel, Pietro Perona; Where to look? Dissociating the effect of reward, salience and attention. Journal of Vision 2009;9(8):421. doi: 10.1167/9.8.421.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

How do distinct sensory and economic attributes like salience and reward combine to guide where we look? Are saccadic decisions dominated by visual salience or reward? Can saccadic decisions, like purely economic decisions, fail to maximize expected reward? To study this, we designed a treasure hunt experiment in which subjects were presented with a brief display containing two targets (horizontal and vertical bar) differing in reward and salience, embedded among 6 tilted distractors. Subjects were instructed to maximize the treasure earned in 0.5 sec, by sequentially fixating on as many stimuli and earning their corresponding reward values. Across 28 blocks, we systematically varied target reward and salience values. We analyzed the first saccade by testing four different hypotheses: 1) the observer searches for the most rewarding item, 2) most salient item, 3) item with highest expected reward, 4) the observer saccades to the location of maximum expected reward. Data from 6 subjects shows that instead of searching for a predefined target, humans optimize reward trial-by-trial, by saccading to the location of maximum expected reward. These findings generalize to other feature dimensions like intensity.

The optimal model predicts, and we empirically validate in humans, that for low internal noise in stimulus representation, intermediate reward values increase the effective stimulus salience multiplicatively, suggesting an underlying neural mechanism of gain control.

Attention has been postulated to operate through a gain control mechanism, which raises an interesting question: are the effects of reward mediated through attention? According to this hypothesis, the rewarding target's features receive greater attention, hence drawing more saccades. In a second experiment, we find that top-down attention to a stimulus feature makes the stimulus appear more salient, however, rewarding a stimulus does not alter its appearance or perceived salience. Thus, reward and attention interact with salience through distinct mechanisms.

Navalpakkam, V. Koch, C. Rangel, A. Perona, P. (2009). Where to look? Dissociating the effect of reward, salience and attention [Abstract]. Journal of Vision, 9(8):421, 421a, http://journalofvision.org/9/8/421/, doi:10.1167/9.8.421. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×