September 2018
Volume 18, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2018
The essential role of recurrent processing during object recognition under occlusion
Author Affiliations
  • Karim Rajaei
    School of Cognitive Sciences (SCS), Institute for Research in Fundamental Sciences (IPM), Niavaran, P.O. Box 19395-5746, Tehran, Iran
  • Yalda Mohsenzadeh
    McGovern Institute for Brain Research, MIT, Cambridge, MA, US
  • Reza Ebrahimpour
    Cognitive Science Research Lab., Department of Electrical and Computer Engineering, Shahid Rajaee Teacher Training University, P.O. Box 16785-163, Tehran, IranSchool of Cognitive Sciences (SCS), Institute for Research in Fundamental Sciences (IPM), Niavaran, P.O. Box 19395-5746, Tehran, Iran
  • Seyed Mahdi Khaligh Razavi
    Computer Science and AI Lab (CSAIL), MIT, Cambridge, MA, USDepartment of Brain and Cognitive Sciences, Cell Science Research Center, Royan Institute for Stem Cell Biology and Technology, ACECR, Tehran, Iran
Journal of Vision September 2018, Vol.18, 906. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Karim Rajaei, Yalda Mohsenzadeh, Reza Ebrahimpour, Seyed Mahdi Khaligh Razavi; The essential role of recurrent processing during object recognition under occlusion. Journal of Vision 2018;18(10):906.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Several recent findings have indicated that the core object recognition is primarily solved through the feedforward sweep of visual information processing. On the other hand, while recurrent connections are ubiquitous in our visual system, their role in object-processing is not yet fully understood. Here, we investigated the contribution of recurrent processes in object recognition under a prevalent challenging condition, that is when objects are occluded by other natural or artificial occluders in the environment. To characterize neural dynamics of object recognition under occlusion, we acquired magnetoencephalography(MEG) data (N=15 subjects), while subjects were presented with images of objects with 0%(no-occlusion),60% and 80%occlusion –with and without backward-masking. We provide evidence from multivariate analysis of MEG data, behavioral data, and computational modelling, demonstrating an essential role for recurrent processes in object recognition under occlusion. First, multivariate analysis of MEG data showed that object discrimination is significantly delayed (by~60ms) under occlusion compared to the no occlusion condition(p< 10^-4, two-sided signrank-test), likely due to the additional time needed for recurrent processes. Second, temporal generalization analysis (King & Dehaene,2014), which provides information about temporal organization of information processing stages, showed that initial sensory signals undergo a relatively long sequence of processing stages that involve recurrent interactions to establish a discriminative representation of occluded objects. Third, backward-masking which is thought to disrupt recurrent processes, impaired MEG object-discrimination time-courses, and subjects' behavioral performances only under occlusion. Fourth, a feedforward CNN failed to explain the MEG data and the behavioral data when objects were occluded; however, a CNN with local recurrent connections reached the human-level performance under occlusion, and partially explained the MEG data for occluded objects. Taken together, our empirical results suggest an essential role for recurrent processing when objects are occluded, and our computational model with local recurrent connections explains how our brain might be solving this problem.

Meeting abstract presented at VSS 2018


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.