August 2012
Volume 12, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   August 2012
Object state-change predicts neural similarity of visual representations before and after a described event
Author Affiliations
  • Nicholas C. Hindy
    University of Pennsylvania
  • Gerry T.M. Altmann
    University of York, UK
  • Emily Kalenik
    University of Pennsylvania
  • Sharon L. Thompson-Schill
    University of Pennsylvania
Journal of Vision August 2012, Vol.12, 1163. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Nicholas C. Hindy, Gerry T.M. Altmann, Emily Kalenik, Sharon L. Thompson-Schill; Object state-change predicts neural similarity of visual representations before and after a described event. Journal of Vision 2012;12(9):1163.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Recent eye-tracking, self-paced reading, and neuroimaging studies suggest that tracking multiple representations of the same object as it undergoes a state-change engenders conflict due to having to distinguish the ‘before’ and ‘after’ states of the object (Altmann and Kamide, 2009; Hindy et al., under review). We use fMRI and multi-voxel pattern analysis to test the degree to which an object state-change causes a distinct neural representation of the same object. We varied whether an object was minimally changed by a described action (e.g., "weigh the pumpkin") or substantially changed by the action (e.g., "carve the pumpkin"), and measured the neural similarity between imagined visual representations of that object before and after the action. Each experiment trial began with a briefly presented object photograph, followed by a sequence of three visual imagery task instructions separated by fixation: imagine the object, then imagine a specified action that involves the object, and finally imagine the object in its final state after the action. Subsequent to the three visual imagery segments, a retrieval cue instructed participants to indicate which of two clipart images is most similar to the object at either the beginning or end of the trial. In object-selective regions of ventral temporal and lateral occipital cortex, we find that the multi-voxel pattern similarity across time points before and after the described action was significantly reduced when the object was substantially changed, compared to when the object was minimally changed. Furthermore, this neural similarity between the ‘before’ and ‘after’ brain states varied parametrically with the rated degree to which the object was changed in state by the described action. Results suggest that, when representing object state-change, a distinct representation of the same object is instantiated in the ventral visual processing pathway, even though the distinct representation is not the result of visual processing.

Meeting abstract presented at VSS 2012


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.