August 2023
Volume 23, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   August 2023
A study of humans and convolutional neural networks on how to recognize blurry objects at the threshold of visibility
Author Affiliations & Notes
  • Hojin Jang
    Department of Brain and Cognitive Sciences, MIT
  • Frank Tong
    Department of Psychology and Vanderbilt Vision Research Center, Vanderbilt University
  • Footnotes
    Acknowledgements  Supported by an NIH R01EY029278 grant to Frank Tong.
Journal of Vision August 2023, Vol.23, 5928. doi:https://doi.org/10.1167/jov.23.9.5928
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Hojin Jang, Frank Tong; A study of humans and convolutional neural networks on how to recognize blurry objects at the threshold of visibility. Journal of Vision 2023;23(9):5928. https://doi.org/10.1167/jov.23.9.5928.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Humans can recognize objects under conditions of severe blur despite a vast loss of high spatial frequency content. Our previous work has suggested that the pervasive occurrence of blur in everyday vision may contribute to robust recognition behavior, as evidenced by the fact that convolutional neural networks (CNNs) optimized to recognize blurry objects can better predict neural responses to objects across diverse viewing conditions in both macaques and humans (Jang & Tong, VSS, 2022). Such findings led us to the following questions. Can humans further improve in their ability to recognize blurry objects with supervised training? Also, do CNNs trained on blurry objects learn robust properties that better approximate human performance, or do they learn alternative shortcut strategies? We devised a novel training protocol in which an initially blurred object gradually became less blurry over time, allowing participants to decide when they were ready to make a classification response about object identity. After the classification response, participants provided a feature saliency map of the diagnostic regions in the blurred image that contributed to their decision using a mouse pointer to demarcate the diagnostic regions. We found that participants showed significant improvement in their blur recognition thresholds after only 4 sessions of perceptual training. Moreover, CNNs optimized to recognize blurry objects provided a better match to participants’ blur recognition thresholds across individual object images. The feature saliency maps of blur-trained CNNs also appeared to lead to somewhat more holistic processing of visual objects, thereby providing a better correspondence with the spatially diagnostic regions of the object images annotated by human observers. Taken together, our study shows that human robustness to blur is highly adaptable, improves with modest training experience, and likely benefits from the frequent encounters that people have with blur in everyday life.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×