August 2009
Volume 9, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2009
A neural model of the visual tuning properties of action-selective neurons in STS and area F5
Author Affiliations
  • Falk Fleischer
    Dept. of Cognitive Neurology, Hertie Institute for Clinical Brain Research and Center for Integrative Neuroscience, Tuebingen, Germany
  • Antonino Casile
    Dept. of Cognitive Neurology, Hertie Institute for Clinical Brain Research and Center for Integrative Neuroscience, Tuebingen, Germany
  • Martin Giese
    Dept. of Cognitive Neurology, Hertie Institute for Clinical Brain Research and Center for Integrative Neuroscience, Tuebingen, Germany
Journal of Vision August 2009, Vol.9, 1106. doi:10.1167/9.8.1106
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Falk Fleischer, Antonino Casile, Martin Giese; A neural model of the visual tuning properties of action-selective neurons in STS and area F5. Journal of Vision 2009;9(8):1106. doi: 10.1167/9.8.1106.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

The visual recognition of goal-directed movements is crucial for the understanding of intentions and goals of others as well as for imitation learning. So far, it is largely unknown how visual information about effectors and goal objects of actions is integrated in the brain. Specifically, it is unclear whether a robust recognition of goal-directed actions can be accomplished by purely visual processing or if it requires a reconstruction of the three-dimensional structure of object and effector geometry.

We present a neurophysiologically inspired model for the recognition of goal-directed grasping movements. The model reproduces fundamental properties of action-selective neurons in STS and area F5. The model is based on a hierarchical architecture with neural detectors that reproduce the properties of cells in visual cortex. It contains a novel physiologically plausible mechanism that combines information on object shape and effector (hand) shape and movement, implementing the necessary coordinate transformations from retinal to an object centered frame of reference. The model was evaluated with real video sequences of human grasping movements, using a separate training and test set. The model reproduces a variety of tuning properties that have been observed in electrophysiological experiments for action-selective neurons in STS and area F5.

The model shows that the integration of effector and object information can be accomplished by well-established physiologically plausible principles. Specifically, the proposed model does not compute explicit 3D representations of objects and the action. Instead, it realizes predictions over time based on learned view-dependent representations for sequences of hand shapes. Our results complement those of existing models for the recognition of goal-directed actions and motivate a more detailed analysis of the complementary contributions of visual pattern analysis and motor representations on the visual recognition of imitable actions.

Fleischer, F. Casile, A. Giese, M. (2009). A neural model of the visual tuning properties of action-selective neurons in STS and area F5 [Abstract]. Journal of Vision, 9(8):1106, 1106a, http://journalofvision.org/9/8/1106/, doi:10.1167/9.8.1106. [CrossRef]
Footnotes
 Supported by DFG (SFB 550), the EC, and Hermann und Lilly Schilling Foundation.
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×