September 2015
Volume 15, Issue 12
Vision Sciences Society Annual Meeting Abstract  |   September 2015
Exploring the visual components that make an image memorable
Author Affiliations
  • Rachit Dubey
    King Abdullah University of Science and Technology, Saudi Arabia
  • Joshua Peterson
    University of California, Berkeley
  • Bernard Ghanem
    King Abdullah University of Science and Technology, Saudi Arabia
  • Ming-Hsuan Yang
    University of California, Merced
  • Po-Jang Hsieh
    Duke-NUS Graduate Medical School, Singapore
Journal of Vision September 2015, Vol.15, 944. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Rachit Dubey, Joshua Peterson, Bernard Ghanem, Ming-Hsuan Yang, Po-Jang Hsieh; Exploring the visual components that make an image memorable. Journal of Vision 2015;15(12):944. doi:

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Recent work by Isola et. al. (2011) has demonstrated that memorability is an intrinsic property of images that is consistent across viewers and can be predicted accurately with current computer vision techniques. Despite progress, a clear understanding of the specific components of an image that drive memorability is still unknown. While previous studies such as Khosla et. al. (2012) have tried to investigate this computationally, no behavioral study has systematically explored the memorability of image regions within individual images. Here we study which regions from an image are memorable or forgettable. Using a large image database, we obtained the memorability scores of the different visual regions present in every image. In our task, participants viewed a series of images, each of which were displayed for 1.4 seconds. After the sequence was complete, participants similarly viewed a series of image regions and were asked to indicate whether each region was seen in the earlier sequence of full images. A selection of these regions were taken from the sequence of images participants viewed previously while the others were taken from images never seen before. We then computed consistency ratings for the memorability of each region across participants. Results indicate the first direct evidence from subject data that memorability of specific image regions is consistent across observers (i.e. individual regions remembered by one viewer are remembered by others as well), and that certain regions within a particular image are more memorable than others. Furthermore, we show that this region memorability is different from bottom-up saliency by demonstrating a weak correlation between the two.

Meeting abstract presented at VSS 2015


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.