December 2022
Volume 22, Issue 14
Open Access
Vision Sciences Society Annual Meeting Abstract  |   December 2022
Impact of visual speech on gaze following in monolingual and bilingual adults
Author Affiliations & Notes
  • Nadia Gregoire-Mitha
    University of British Columbia
  • Jason J S Barton
    University of British Columbia
  • Mairéad MacSweeney
    University College London
  • Carly A Anderson
    University of British Columbia
    University College London
  • Footnotes
    Acknowledgements  This work was supported by a Welcome Trust Fellowship awarded to CA [221612/Z/20/Z]. JB was supported by a Canada Research Chair (950-232752) & the Marianne Koerner Chair in Brain Diseases. The study was supported by a Natural Sciences & Engineering Research Council Discovery Grant (RGPIN 319129).
Journal of Vision December 2022, Vol.22, 3360. doi:https://doi.org/10.1167/jov.22.14.3360
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Nadia Gregoire-Mitha, Jason J S Barton, Mairéad MacSweeney, Carly A Anderson; Impact of visual speech on gaze following in monolingual and bilingual adults. Journal of Vision 2022;22(14):3360. https://doi.org/10.1167/jov.22.14.3360.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Altered sensory and language experience can shape visual attention to faces. Hearing bilingual infants show increased visual attention to the mouth compared to monolingual infants. It is unclear how this altered visual attention to the face influences the processing of other crucial social cues, such as eye gaze. The goal of this online study was to determine how visual speech and participant’s prior language experience influences gaze following. Monolingual (n=20) and bilingual (n=22) hearing native English speakers (21.4 ± 2.7 yrs) were tested. The second language of bilingual participants encompassed a range of other languages. Participants performed a peripheral target discrimination task, preceded by cues to the target location that had equal probability of being valid or invalid. Cues were either arrow cues (a non-social control) or eye-gaze cues in a concurrently viewed static face. For these social gaze conditions, gaze shifts were accompanied by either: i) closed neutral mouth, ii) speech cues (linguistic mouth movements), or iii) non-speech cues (non-linguistic mouth movements). The magnitude of the gaze cueing effect was quantified as the difference between response times (RTs) on correctly performed valid and invalid trials. As a potential correlate, the lipreading ability of the subjects was assessed separately using an open-response, consonant-vowel-consonant word test. Across all conditions, bilinguals demonstrated a smaller gaze-cueing effect than monolinguals. In bilingual participants only, lipreading proficiency positively correlated with the gaze cueing effect when visual speech cues were also present, but not in non-speech conditions. Our results show that language experience can impact attentional orienting to facial cues. The effect in bilingual subjects may reflect enhanced division and shifting of attention between the eyes and the mouth when linguistic information is present in those participants who are more fluent lipreaders.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×