May 2008
Volume 8, Issue 6
Free
Vision Sciences Society Annual Meeting Abstract  |   May 2008
The role of Fourier phase information in predicting saliency
Author Affiliations
  • Robert Peters
    University of Southern California, Computer Science
  • Laurent Itti
    University of Southern California, Computer Science, Neuroscience, Psychology
Journal of Vision May 2008, Vol.8, 879. doi:https://doi.org/10.1167/8.6.879
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Robert Peters, Laurent Itti; The role of Fourier phase information in predicting saliency. Journal of Vision 2008;8(6):879. https://doi.org/10.1167/8.6.879.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Global amplitude spectra from the discrete Fourier transform (DFT) have proven useful in studying behavioral and computational aspects of visual object and scene recognition. Here, we investigated whether Fourier phase (rather than amplitude) spectra may be useful for another purpose, namely guiding attentional selection. We developed a simple model which produces salience maps from phase information alone, by (1) downsampling images by one or more factors, (2) computing the DFT of each downsampled image's luminance, (3) normalizing each complex DFT value to unit amplitude while retaining its phase, (4) computing the inverse DFT, (5) squaring the result, and (6) combining the maps resulting from each downsampling factor. Salience maps from this model significantly predicted the free-viewing gaze patterns of four observers for 337 images of natural outdoor scenes, fractals, and aerial imagery. For fractals and aerial imagery, this phase-based model was significantly better (paired t-test, ppf power spectra, so forcing a flat Fourier amplitude spectrum is similar to scaling the amplitude everywhere by f, equivalent to a spatial derivative. However, this derivative-like aspect cannot completely explain our results, because the image category with the most 1/f-like spectrum (outdoor scenes) was the one for which the phase-only model fared worst. Just as Fourier amplitude can form a computational basis for scene categorization (Torralba 2003), our results establish Fourier phase information as one possible computational basis for spatial attentional selection.

Peters, R. Itti, L. (2008). The role of Fourier phase information in predicting saliency [Abstract]. Journal of Vision, 8(6):879, 879a, http://journalofvision.org/8/6/879/, doi:10.1167/8.6.879. [CrossRef]
Footnotes
 
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×