September 2015
Volume 15, Issue 12
Free
Vision Sciences Society Annual Meeting Abstract  |   September 2015
Convergence and divergence in the neural organization of object responses to pictures and words
Author Affiliations
  • Talia Konkle
    Department of Psychology, Harvard University
  • Xiaoying Wang
    State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, China
  • Marius Peelen
    Center for Mind/Brain Sciences, University of Trento, Italy
  • Alfonso Caramazza
    Department of Psychology, Harvard University Center for Mind/Brain Sciences, University of Trento, Italy
  • Yanchao Bi
    State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, China
Journal of Vision September 2015, Vol.15, 375. doi:https://doi.org/10.1167/15.12.375
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Talia Konkle, Xiaoying Wang, Marius Peelen, Alfonso Caramazza, Yanchao Bi; Convergence and divergence in the neural organization of object responses to pictures and words. Journal of Vision 2015;15(12):375. https://doi.org/10.1167/15.12.375.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Visual information is transformed from early sensory formats into increasingly abstract representations of its content. We probed this abstraction by exploring the convergence in the neural responses to pictures of objects and their spoken names, taking a broad look at several major semantic divisions between object categories. Our aim was to explore which neural regions show reliable responses that are specific to visual pictures, specific to auditory words, or common between these two modalities, using a data-driven clustering approach. Using fMRI, we measured neural response patterns to objects from 18 broad semantic categories, presented as both pictures and auditory words, in 16 participants. We used a clustering technique to group together voxels by their response profile similarity over these 18 categories, in a way that is agnostic to where the voxels are located and whether they reflect responses from the visual or auditory modality. They key advantage of this procedure is that it simultaneously discovers common and unique structure across both modalities without presupposing any regional boundaries in advance. This analysis identified several regions with similar neural profiles to pictures and words (parahippocampal, transverse occipital sulcus, retrosplenial cortex), which primarily had a response preference for inanimate categories of objects. In contrast, other neural regions were only reliably modulated by pictorial stimuli (lateral occipital, fusiform), and these regions primarily had a response preference to pictures of animate entities. Taken together, these results demonstrate a surprising and currently unexplained link between the neural organization of broad object domains and activations by different modalities.

Meeting abstract presented at VSS 2015

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×