September 2021
Volume 21, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2021
Revealing the Relative Contributions of Conceptual and Perceptual Information to Visual Memorability
Author Affiliations
  • Max Kramer
    University of Chicago
  • Martin Hebart
    Max Planck Institute of Human Cognitive and Brain Sciences
  • Chris Baker
    National Institute of Mental Health
  • Wilma Bainbridge
    University of Chicago
Journal of Vision September 2021, Vol.21, 2048. doi:https://doi.org/10.1167/jov.21.9.2048
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Max Kramer, Martin Hebart, Chris Baker, Wilma Bainbridge; Revealing the Relative Contributions of Conceptual and Perceptual Information to Visual Memorability. Journal of Vision 2021;21(9):2048. https://doi.org/10.1167/jov.21.9.2048.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Visual Memorability has been shown to be an intrinsic property of images, yet it remains unclear what combination of image properties fully define visual memorability. We tested memory performance on the THINGS database (Hebart et al, 2019), a database of 26,107 images from 1854 different object categories, quantified by embeddings in a 49-dimensional space reflecting perceptual and conceptual components underlying human similarity judgments. We used these embeddings to examine image memorability in the context of this high dimensional object space. We carried out a continuous recognition task on 13,496 AMT participants, providing us with memorability scores for all images in the THINGS database. We observed significant consistency across participants’ memory performance, allowing us to use memorability as an intrinsic attribute for each image. Our findings identified no significant correlation between memorability and ratings of typicality, suggesting that different images were memorable for different reasons. Correlations between the 49 dimensions and the memorability scores revealed that some dimensions (e.g. animal-relatedness) are more strongly associated with memorability than others (e.g. hardness). We capitalized on the nature of the dimensions as either perceptual or conceptual by focusing on relative contributions of perceptual and conceptual information to memorability. Using ratings of the dimensions along a scale from purely conceptual to purely perceptual, we analyzed the differences in correlation with memorability, variance in corrected recognition (hit rate – false alarm rate), and differences in raw embedding values between perceptual and conceptual dimensions. Our results indicated a stronger correlation with memorability for conceptual information than perceptual, where conceptual dimensions captured 31.72% of variance while perceptual dimensions only captured 6.07%. These results may indicate a greater contribution of conceptual information to the memorability of an image, suggesting a target for further study of the structure of visual memorability.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×