December 2022
Volume 22, Issue 14
Open Access
Vision Sciences Society Annual Meeting Abstract  |   December 2022
Visual recognition of single body parts in natural images
Author Affiliations & Notes
  • Ziwei Liu
    University of Minnesota
  • Daniel Kersten
    University of Minnesota
  • Footnotes
    Acknowledgements  This study was supported by the National Institutes of Health under award number R01EY029700.
Journal of Vision December 2022, Vol.22, 4419. doi:https://doi.org/10.1167/jov.22.14.4419
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Ziwei Liu, Daniel Kersten; Visual recognition of single body parts in natural images. Journal of Vision 2022;22(14):4419. https://doi.org/10.1167/jov.22.14.4419.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Visual information about the human body is naturally organized in terms of body parts and their spatial relationships. Previous behavioral studies of body perception have largely focused on the visual interpretation of whole bodies using simplified stimuli. This leaves open the question of how well human observers can recognize individual body parts given limited spatial context and temporal constraints, and given the complex variability in appearances typical of natural images. To answer this question, we measured the accuracies with which human observers can recognize individual body parts in static natural images as a function of the amount of spatial information and stimulus duration. In an online experiment, observers were asked to identify one of eight body joints from natural images seen through small square apertures. The apertures were cropped from 340 images selected from MPII Human Pose dataset at widths that ranged from 12 to 60 pixels. These test images were presented randomly at durations that varied from 50 milliseconds to 2000 milliseconds, with or without backward masking. We found that recognition accuracy grew approximately linearly with aperture size from chance levels at 12.5% at the smallest size, to between 40 and 60%, depending on duration, at the maximum size. At the shortest duration, accuracy systematically increased from chance to 50% as a function of size. As duration increased accuracy reached over 50% at 36 pixels, leveling off to about 75% after 500 milliseconds. Additional experiments using Leeds Sports Pose Dataset largely replicated these findings. Our results suggest that human observers can use low- and mid-level cues extracted at a fairly early stage of visual processing. In addition, our data provide a useful benchmark of relatively comprehensive observation on human performance with which to compare computational models of single body part recognition in natural images.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×