February 2016
Volume 16, Issue 4
Open Access
OSA Fall Vision Meeting Abstract  |   February 2016
Scanpaths Can Enhance Saliency Estimation in Photographs
Author Affiliations
  • Bruce Bridgeman
    University of California Santa Cruz
  • Steven Scher
    University of California Santa Cruz
Journal of Vision February 2016, Vol.16, 19. doi:https://doi.org/10.1167/16.4.10
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Bruce Bridgeman, Steven Scher; Scanpaths Can Enhance Saliency Estimation in Photographs. Journal of Vision 2016;16(4):19. https://doi.org/10.1167/16.4.10.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Automatic saliency algorithms have become useful in identifying important areas in photographic images. We compare two popular algorithms with scanpaths of human eye movements on the same images. Eye movements are sampled at 1kHz with a Bouis infrared high-resolution eye tracker calibrated on a 5×5 point grid. We estimate the average time spent looking at each pixel by convolving with a gaussian filter that spreads the contribution of each measurement over an area matched to the accuracy of the measurement. The saliency algorithms are the ‘Itti’ algorithm (Itti, Koch & Niebur, 1998) and the Graph Based Visual Saliency (GBVS) algorithm (Harel, Koch & Perona, 2006). Both find salient areas in several steps by normalizing an image and finding regions of maximum contrast between adjacent regions. By brightening regions where eye fixations are longest and most frequent we can compare the performance of the automatic algorithms with human exploratory behavior. We find that the algorithms and the human data from three observers correlate well for many images, but for others there are significant discrepancies. Specifically, the automatic methods sometimes pick up incidental background texture that humans ignore. Also, there are individual differences in the human scanpaths. Both algorithms perform about equally well.

Harel J., Koch C., Perona P. 2006 Graph based visual saliency Proceedings of Neural Information Processing Systems (NIPS)
Itti L., Koch C., E. Niebur E. 2008 A model of saliency based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine
 Supported by LANL ISSDM and NSF #CCF-0746690.

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.