June 2004
Volume 4, Issue 8
Vision Sciences Society Annual Meeting Abstract  |   August 2004
Verb-driven shifts of attention during sentence comprehension and dynamic scene processing
Author Affiliations
  • Roberto G. Almeida
    Department of Psychology, Concordia University, Montreal, Canada
Journal of Vision August 2004, Vol.4, 828. doi:10.1167/4.8.828
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to Subscribers Only
      Sign In or Create an Account ×
    • Get Citation

      Roberto G. Almeida, Zinnia Madon, Caroline Velde, Julia Di Nardo, Jacob Godfrey, Michael W. Grunau; Verb-driven shifts of attention during sentence comprehension and dynamic scene processing. Journal of Vision 2004;4(8):828. doi: 10.1167/4.8.828.

      Download citation file:

      © 2016 Association for Research in Vision and Ophthalmology.

  • Supplements

We investigated how dynamic scene perception and sentence comprehension processes interact. Eye movements were monitored while participants watched motion pictures of events and listened to related sentences. Each scene contained an agent (corresponding to the grammatical subject of sentence) and different types of objects (with one corresponding to the grammatical object of the main verb in the sentence; the target). Three types of agent motion conditions were created: (a) towards the target object, (b) away from the target object, and (c) neutral — in which the agent did not move towards or away the target object. These three types of scenes were combined with sentence pairs differing only by verb type (e.g., Before preparing the dessert, the cook will crack/inspect the egg that is on the counter). We contrasted highly constraining causatives (e.g., crack, bend, fold) with weakly constraining psychological or perceptual verbs (e.g., see, notice, inspect). Participants were instructed to watch the movies and to listen to their respective sentences. Verb onsets were synchronized with frames in the movies that signaled the beginning of agent motion. We measured saccade onset times to target objects from verb onsets. Results showed a significant effect of motion type (neutral slower than “away” and “towards”). There was also a significant effect of verb type (causative faster than perception/psychological) only in the “away” condition. These results will be discussed in the context of a model of the interaction between independently processed visual and linguistic inputs.

de  Almeida, R. G., Madon, Z., van de  Velde, C., Di Nardo, J., Godfrey, J., von  Grunau, M. W.(2004). Verb-driven shifts of attention during sentence comprehension and dynamic scene processing [Abstract]. Journal of Vision, 4( 8): 828, 828a, http://journalofvision.org/4/8/828/, doi:10.1167/4.8.828. [CrossRef]
 Research funded by grants from FQRSC and SSHRC (to RGdA) and from NSERC (to MWvG)

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.