October 2003
Volume 3, Issue 9
Vision Sciences Society Annual Meeting Abstract  |   October 2003
Interaction between vision and speech in face recognition
Author Affiliations
  • Isabelle Bülthoff
    Max-Planck-Institut für biologische Kybernetik, Germany
  • Fiona N Newell
    Trinity College, Ireland
Journal of Vision October 2003, Vol.3, 825. doi:https://doi.org/10.1167/3.9.825
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Isabelle Bülthoff, Fiona N Newell; Interaction between vision and speech in face recognition. Journal of Vision 2003;3(9):825. https://doi.org/10.1167/3.9.825.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Many face studies have shown that in memory tasks, distinctive faces are more easily recognized than typical faces. All these studies were performed with visual information only. We investigated whether a cross-modal interaction between auditory and visual stimuli exists for face distinctiveness. Our experimental question was: Can visually typical faces become perceptually distinctive when they are accompanied by voice stimuli that are distinctive? In a training session, participants were presented with faces from two sets. In one set all faces were accompanied by characteristic auditory stimuli during learning (d-faces: different languages, intonations, accents, etc.). In the other set, all faces were accompanied by typical auditory stimuli during learning(s-faces: same words, same language). Face stimuli were counterbalanced across auditory conditions. We measured recognition performance in an old/new recognition task. Face recognition alone was tested. Our results show that participants were significantly better (t(12) = 3.89, p< 0.005) at recognizing d-faces than s-faces in the test session. These results show that there is an interaction between different sensory inputs and that typicality of stimuli in one modality can be modified by concomitantly presented stimuli in other sensory modalities.

Bülthoff, I., Newell, F. N.(2003). Interaction between vision and speech in face recognition [Abstract]. Journal of Vision, 3( 9): 825, 825a, http://journalofvision.org/3/9/825/, doi:10.1167/3.9.825. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.