August 2009
Volume 9, Issue 8
Free
Vision Sciences Society Annual Meeting Abstract  |   August 2009
Two views of the world: Active vision, attention, and perception and action loops in real-world interaction
Author Affiliations
  • Chen Yu
    Department of Psychological and Brain Sciences, Indiana University Bloomington
  • Linda Smith
    Department of Psychological and Brain Sciences, Indiana University Bloomington
  • Alfredo Pereira
    Department of Psychological and Brain Sciences, Indiana University Bloomington
  • Sean Matthrews
    Department of Psychological and Brain Sciences, Indiana University Bloomington
  • Hongwei(Henry) Shen
    Department of Psychological and Brain Sciences, Indiana University Bloomington
Journal of Vision August 2009, Vol.9, 419. doi:10.1167/9.8.419
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to Subscribers Only
      Sign In or Create an Account ×
    • Get Citation

      Chen Yu, Linda Smith, Alfredo Pereira, Sean Matthrews, Hongwei(Henry) Shen; Two views of the world: Active vision, attention, and perception and action loops in real-world interaction. Journal of Vision 2009;9(8):419. doi: 10.1167/9.8.419.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

We report new findings using a novel method that seeks to describe the visual learning environment from a young child's point of view. The method consists of a multi-camera sensing environment consisting of two head-mounted mini cameras that are placed on both the child's and the parent's foreheads respectively. Two video streams from two first-person views were recorded simultaneously and as well as their head and hand movements in the interaction. Computational and data mining techniques were applied to detect various objects in the two views, and then discover reliable visual and perceptual patterns from these simultaneous views. In addition, Itti's saliency map algorithm was also employed to find saliency areas/pixels in terms of motion, orientation and intensity. The main result is that the adult's and child's views are fundamentally different in (1) the spatial distributions of hands and everyday objects in the child's visual field and where they are in the parent's field; (2) the salience of individual objects and hands in those two visual fields; and (3) the temporal dynamic structures of objects and hands in two views. Moreover, by correlating visual information with body movement data, we also found that the dramatic difference in two views is largely due to head and hand movements of both the young child and their social partner. In a recent study, we also recorded momentary eye movements from the parent which allowed us to pair the parent's visual attention with the child's visual attention, and further analyze how they jointly attended to the same objects and how one person's visual attention is dynamically coupled with the other person's visual attention. These findings have broad implications for how one studies and thinks about the critical role of embodied active vision and selective attention in various cognitive learning tasks and developmental processes.

Yu, C. Smith, L. Pereira, A. Matthrews, S. Shen, H. (2009). Two views of the world: Active vision, attention, and perception and action loops in real-world interaction [Abstract]. Journal of Vision, 9(8):419, 419a, http://journalofvision.org/9/8/419/, doi:10.1167/9.8.419. [CrossRef]
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×