October 2003
Volume 3, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   October 2003
fMRI studies of multi-modal semantic knowledge using artificial concepts
Author Affiliations
  • Thomas W James
    Psychology Department, Vanderbilt University, USA
Journal of Vision October 2003, Vol.3, 197. doi:https://doi.org/10.1167/3.9.197
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Thomas W James, Isabel Gauthier; fMRI studies of multi-modal semantic knowledge using artificial concepts. Journal of Vision 2003;3(9):197. doi: https://doi.org/10.1167/3.9.197.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Recent findings suggest that semantic memories may be stored in multiple modalities, as opposed to being stored using an amodal code. Furthermore, these findings suggest that semantics from different modalities may be stored in modality-specific processing regions of the cortex. We tested these ideas using novel objects and artificial concepts. Objects were divided into sets of four and were all highly visually similar, biological looking, and three-dimensional. Artificial concepts were triads of semantic features (presented as words) from the auditory (AUD) modality (e.g. howls, squeals, etc.), the tactile (TAC) modality (e.g. hard, cold, etc.), or a combination (SEM) of modalities (e.g. noisy, soft, friendly, etc.). Objects and artificial concepts were associated during two one-hour training sessions prior to scanning. During scanning, participants performed a simultaneous match task, a task that could be performed using only the information in the visual images, and without explicit reference to the trained concepts. As expected, objects in the AUD condition produced more activation along the superior temporal gyrus than objects in a NON-trained condition. TAC objects produced less activation in parietal and occipital cortex than NON objects. One speculation is that the TAC concepts actually interfered with visual processing, because they invoked associated visual features that were incongruent with the visual stimulus. SEM objects produced more activation in the inferior frontal and fusiform gyrus compared to a name-only condition and the NON condition. In conclusion, associating artificial concepts with novel objects produced activation in similar regions to those found with familiar objects, despite the fact that associations were developed over a short time period, and the test task was implicit. These regions respond in a modality-specific manner and they are found near modality-specific perceptual processing regions.

James, T. W., Gauthier, I.(2003). fMRI studies of multi-modal semantic knowledge using artificial concepts [Abstract]. Journal of Vision, 3( 9): 197, 197a, http://journalofvision.org/3/9/197/, doi:10.1167/3.9.197. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.