September 2019
Volume 19, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2019
Jointly perceiving physics and mind
Author Affiliations & Notes
  • Haokui Xu
    Department of Statistics, UCLA
  • Ning Tang
    Department of Statistics, UCLA
  • Mowei Shen
    Department of Human Behavior and Psychological Sciences, Zhejiang University
  • Tao Gao
    Department of Statistics, UCLA
    Department of Communication, UCLA
Journal of Vision September 2019, Vol.19, 280d. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Haokui Xu, Ning Tang, Mowei Shen, Tao Gao; Jointly perceiving physics and mind. Journal of Vision 2019;19(10):280d.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Physics and mind are “dark matters” governing the structure of a visual scene. Even a simple physics-mind combination can generate remarkably rich events. In a leashed-chasing display introduced here, a disc (“wolf”) has the mind of chasing another disc (“sheep”), while the wolf is physically constrained by a leash controlled by a third disc (“master”). Competing forces from physics and mind can cause complicated motions, such as a wolf being dragged away from the target it is chasing. Therefore, the task of vision is to jointly infer the physics-mind combination that can best explain the observed motions. Guided by this theory, we demonstrate four discoveries with the leashed-chasing display. First, social perception of the wolf’s mind is robust, even when its motion severely deviates from its goal, provided the deviation can be explained away by physics. Second, social perception is robust even when the wolf is not shown as an isolated object by explicitly drawing a line connecting it to its master, provided the line is modeled as a physically realistic spring. Third, disrupting physics impairs social perception. By simply offsetting the master’s trajectory by 500ms in the visual display, the wolf-master system cannot be modeled by any intuitive physics. Accuracy of perceived chasing dropped dramatically, as there was no physics to “explain away” the wolf’s deviation from its goal. Fourth, disrupting an agent’s mind impairs the perception of physics. The mind of the wolf is disrupted by making it chase a “phantom”, achieved by turning its target invisible. Observers were asked to report whether the leash is a physically realistic spring, or just an arbitrary line connecting two independently moving objects. The results showed that accuracy of spring detection dropped dramatically when the wolf’s mind was disrupted. These results collectively demonstrate a joint perception of physics and mind.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.