September 2024
Volume 24, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2024
The visual memorability of natural warning patterns: insights from humans and machines
Author Affiliations & Notes
  • Federico De Filippi
    University of St Andrews, St Andrews, United Kingdom
  • Olivier Penacchio
    University of St Andrews, St Andrews, United Kingdom
    Computer Vision Center, Universitat Autònoma de Barcelona, Barcelona, Spain
  • Akira R. O'Connor
    University of St Andrews, St Andrews, United Kingdom
  • Julie M. Harris
    University of St Andrews, St Andrews, United Kingdom
  • Footnotes
    Acknowledgements  This work is funded by the Biotechnology and Biological Sciences Research Council (United Kingdom Research and Innovation)
Journal of Vision September 2024, Vol.24, 248. doi:https://doi.org/10.1167/jov.24.10.248
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Federico De Filippi, Olivier Penacchio, Akira R. O'Connor, Julie M. Harris; The visual memorability of natural warning patterns: insights from humans and machines. Journal of Vision 2024;24(10):248. https://doi.org/10.1167/jov.24.10.248.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

While some animals camouflage themselves, others advertise that they are toxic using bright colours and salient stripes and/or spots (‘warning patterns’). Their striking appearance is thought to warn off predators: a memorable pattern may help predators learn about toxicity and discourage future attacks on similar prey. However, how warning patterns influence visual memory has never been documented. Research suggests that when glancing at a picture, people do not intuitively know what makes it memorable or forgettable, but they remember and forget the same images (i.e., there is high inter-subject consistency). This means that the likelihood of remembering a picture (its ‘memorability’) can be computationally predicted from the visual information contained in the picture. Memorable images also lead to stronger neural firing when processed by real and artificial visual systems. We used a database of Lepidoptera (butterfly/moth) images, some of which carry warning signals (aposematic: AP), and some which do not (non aposematic: nAP). We measured human memorability for both AP and nAP Lepidoptera and examined the sources of memorability variation across subjects. Observers studied images while providing subjective ratings (1-10) of memorability, followed by a recognition test (‘Seen before?’). Memorability was computed as the proportion of subjects who remembered previously seeing each image. AP species appeared subjectively more memorable than nAP ones, but, on average, they were not better remembered. Remarkably, AP species led to high inter-subject consistency in memorability (Spearman’s rho = .79), but consistency for nAP species was comparatively low (Spearman’s rho = .37). When we exposed our Lepidoptera patterns to deep neural networks trained for object classification, we found that AP species that were memorable to humans also evoked stronger neural responses in some hidden layers. Taken together, these findings suggest that warning patterns might exploit shared visual mechanisms that underlie successes and failures in picture recognition.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×