October 2003
Volume 3, Issue 9
Free
Vision Sciences Society Annual Meeting Abstract  |   October 2003
(Eye-)Tracking the time-course of the interaction between linguistic and visual processes: the effect of verb-conceptual restrictions
Author Affiliations
  • Roberto G. Almeida
    Department of Psychology, Concordia University, Montreal, Quebec, Canada
  • Caroline Velde
    Department of Psychology, Concordia University, Montreal, Quebec, Canada
  • Michael W. Grunau
    Department of Psychology, Concordia University, Montreal, Quebec, Canada
  • Cesar Galera
    FFCLRP, USP, Brazil
Journal of Vision October 2003, Vol.3, 308. doi:https://doi.org/10.1167/3.9.308
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Roberto G. Almeida, Caroline Velde, Michael W. Grunau, Cesar Galera; (Eye-)Tracking the time-course of the interaction between linguistic and visual processes: the effect of verb-conceptual restrictions. Journal of Vision 2003;3(9):308. https://doi.org/10.1167/3.9.308.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

We present a study on the role of visual representations in the access to conceptual structure of verbs during sentence processing. In our study, we used an eye-tracking paradigm in which subjects heard sentences while looking at pictures of objects displayed on a computer screen. We controlled the time course of saccade onsets to pictures of objects by holding and releasing the saccades at different points during and after the presentation of verbs and their complements. We contrasted two classes of linguistic constructions, a highly constraining causative construction in which there is a close conceptual relation between verb and direct object (e.g., The woman burned the candle), and a neutral one with a transitive perception verb (e.g., The woman admired the candle). As visual stimuli we used pictures of six types of objects, a target object (the referent of the noun grammatical object of the verb; e.g., candle), a semantic competitor (e.g., lamp), a phonological competitor (e.g., candy), an object with the same shape as the target, an object with the same color as the target, and a random object. We found significant differences between probe points and context types, with causative verbs engendering faster saccade onset times to their objects. This difference was more pronounced at the onset of the main verb. The magnitude of the saccade onset times for both sentence conditions, however, indicates that verb-conceptual effects occur after verb information is accessed. The results of these experiments are discussed in the context of modular and interactive cognitive architectures. We propose a model for the time-course of the interaction between linguistic and visual information in short-term memory.

de  Almeida, R. G., van de  Velde, C., von  Grunau, M. W., Galera, C.(2003). (Eye-)Tracking the time-course of the interaction between linguistic and visual processes: the effect of verb-conceptual restrictions [Abstract]. Journal of Vision, 3( 9): 308, 308a, http://journalofvision.org/3/9/308/, doi:10.1167/3.9.308. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×