August 2023
Volume 23, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   August 2023
Top-down and within-layer recurrent connections in artificial networks are needed to solve challenging visual tasks
Author Affiliations
  • Andrea Ivan Costantino
    KU Leuven
  • Hans Op de Beeck
    KU Leuven
Journal of Vision August 2023, Vol.23, 5008. doi:https://doi.org/10.1167/jov.23.9.5008
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Andrea Ivan Costantino, Hans Op de Beeck; Top-down and within-layer recurrent connections in artificial networks are needed to solve challenging visual tasks. Journal of Vision 2023;23(9):5008. https://doi.org/10.1167/jov.23.9.5008.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Research in human vision has shown that visual recognition is achieved through the interaction of a number of specialized brain areas in the ventral and dorsal visual stream. The most influential models of visual perception theorize a feedforward, unidirectional flow of information from low-level to high-level areas. However, growing evidence suggests, on the one hand, that lateral connections and connections from high- to low-level areas (i.e., top-down connections) may be crucially involved in more challenging object recognition tasks, and on the other hand that recurrent networks show higher correlation and have better predictivity of brain data. In this study, we explore the functional role of feedback connections in computational models of vision. To do so, we trained several Convolutional Neural Networks (CNNs) with and without recurrent connections (within layers, top-down, top-down + within) to perform object recognition tasks in relatively easy (e.g., normal stimuli) and more challenging (e.g., low/high partial occlusion, deletion, clutter, phase scrambling) conditions. Preliminary data shows an effect of the manipulation, where challenging tasks are indeed more problematic to solve, and, most importantly, are associated with higher average performance of the networks with recurrent processing. Across our recurrent networks, our data shows highest performance for the top-down + within network, and different -- but complementary -- advantages of the within and top-down networks over the feedforward ones. Overall, our results suggest that i) feedback processing in CNNs is critical to solve challenging visual tasks, and ii) that within layers and top-down signals have different functional roles -- i.e., different tasks are solved by different feedback connection types.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×