September 2021
Volume 21, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2021
Visual to motor cross-decoding of hand shapes from mirror neuron activity
Author Affiliations & Notes
  • Eleftheria Tzamali
    Medical School, University of Crete
  • Vassilis Papadourakis
    Medical School, University of Crete
  • Vassilis Raos
    Medical School, University of Crete
  • Footnotes
    Acknowledgements  This research is co-financed by Greece and the European Union (European Social Fund-ESF) through the Operational Programme «Human Resources Development, Education and Lifelong Learning 2014-2020» in the context of project MIS 5048512.
Journal of Vision September 2021, Vol.21, 2273. doi:https://doi.org/10.1167/jov.21.9.2273
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Eleftheria Tzamali, Vassilis Papadourakis, Vassilis Raos; Visual to motor cross-decoding of hand shapes from mirror neuron activity. Journal of Vision 2021;21(9):2273. https://doi.org/10.1167/jov.21.9.2273.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

We recently demonstrated that the dorsal premotor cortex (PMd) of macaque monkeys houses mirror neurons (MirNs). MirNs, originally described in the ventral premotor cortex, are sensorimotor neurons that fire both when an animal performs an action and when the same animal observes another agent performing an identical or similar action. Here, we investigate whether a decoder trained on the activity induced during action-observation can reliably distinguish hand grips using the activity induced during action-execution. To this end, we use neuronal spiking cortical activity recorded from the PMd of macaques engaged in execution and observation of reaching-to-grasp actions. Decoding of actions is done by a Support Vector Machine with a linear kernel function using the activity occurred in 200 ms periods (starting 800 ms before and ending 1400 ms after movement onset) at various temporal combinations between observation and execution. Classification performance, using either the whole set of units (n=140) or subsets of units of various sizes, was at 50% regardless of the number of included units. To overcome this issue, a greedy-approach was employed: the unit with the best performance was initially selected and at each subsequent step a unit was added to those of the previous step so that to maximize the performance of the resulting population. Following this approach we reached cross-decoding accuracy above 90% using less than half of the population. Thus, a selected subset of units, that shares the same computations in the execution and observation, is sufficient for effective and consistent inter-condition decoding of grips. These results demonstrate that PMd-MirNs can provide a reliable signal for the development of grip decoders which could be trained even when the required registration of neural activity and behavior can’t be obtained due to the incapability of generating overt movements.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×