August 2009
Volume 9, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2009
Virtual brain reading: A connectionist approach to understanding fMRI patterns
Author Affiliations
  • Rosemary Cowell
    Centre for Cognitive Neuroscience and Cognitive Systems, Computing Laboratory, University of Kent, and Computer Science and Engineering, University of California, San Diego
  • Garrison Cottrell
    Computer Science and Engineering, University of California, San Diego
Journal of Vision August 2009, Vol.9, 472. doi:https://doi.org/10.1167/9.8.472
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Rosemary Cowell, Garrison Cottrell; Virtual brain reading: A connectionist approach to understanding fMRI patterns. Journal of Vision 2009;9(8):472. https://doi.org/10.1167/9.8.472.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Is the fusiform face area (FFA) a module specialized for processing faces, or does it simply support generic visual expertise? Researchers have investigated this question using Multi-Voxel Pattern Analysis (MVPA) applied to fMRI results. Haxby et al. (2001) showed that patterns of neural activation in object-selective visual cortex can be used to discriminate object categories, even when voxels selective for those categories are removed. This provided evidence for a distributed neural code, in which information about faces exists outside the FFA. In contrast, Spiridon and Kanwisher (2002) showed that activation patterns in face-selective cortex were more effective for making face vs. non-face discriminations than for non-face vs. non-face discriminations, whereas this was not true for other object categories. This implied FFA neurons contain special information about faces, but that there is no specialized module for other categories.

We applied MVPA to our neurocomputational model of visual processing. Images are subject to Gabor filtering, then PCA, then input to a Kohonen network — a self-organizing neural network that groups similar inputs together, forming a two-dimensional “semantic map” of stimulus space. We trained the model on images of cups, cans, books and faces. As in Haxby et al. (2001), activity of units in areas dedicated to one category can be used to distinguish other categories. However, in line with Spiridon and Kanwisher, the face area is better at distinguishing faces from non-faces than at distinguishing non-face categories from each other, while non-face areas are on average equipotent at both tasks. In the model, this can be explained by lower within-category variability of faces in the representations compared to, say, cups. Hence, in a model of visual cortex possessing no special mechanism for face processing, we simulate Spiridon and Kanwisher's results, casting doubt on their interpretation in favor of a specialized face module.

Cowell, R. Cottrell, G. (2009). Virtual brain reading: A connectionist approach to understanding fMRI patterns [Abstract]. Journal of Vision, 9(8):472, 472a, http://journalofvision.org/9/8/472/, doi:10.1167/9.8.472. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×