May 2008
Volume 8, Issue 6
Free
Vision Sciences Society Annual Meeting Abstract  |   May 2008
Image statistics for 3D shape estimation
Author Affiliations
  • Roland Fleming
    Max Planck Institute for Biological Cybernetics
  • Yuanzhen Li
    Dept. of Brain and Cognitive Sciences, MIT
  • Edward Adelson
    Dept. of Brain and Cognitive Sciences, MIT
Journal of Vision May 2008, Vol.8, 76. doi:10.1167/8.6.76
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Roland Fleming, Yuanzhen Li, Edward Adelson; Image statistics for 3D shape estimation. Journal of Vision 2008;8(6):76. doi: 10.1167/8.6.76.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Most accounts of ‘Shape-from-X’ start with a computational theory of a particular cue, then outline methods for extracting relevant data from the image. Here we take the opposite approach, starting with image statistics and investigating how they might be exploited to estimate shape across variations in lighting, reflectance and texture. We rendered a large number objects and looked for image statistics that vary systematically with properties of the shape. We find several simple measurements — derived from filters at different orientations and scales — yield surprisingly reliable information about 3D shape. In a series of experiments we show that changes in these statistics predict certain successes and failures of human perception.

In a gauge probe task, shape perception remained remarkably constant across changes in surface reflectance (glossiness, albedo). Although the images differ substantially on a pixel-by-pixel basis, the orientation statistics remain stable across these reflectance changes, suggesting they could be the basis of human performance.

In another task, observers were presented with shaded objects that had been subjected to certain shape transformations. The task was to adjust the magnitude of shear or stretch of a textured object until it appeared to be the same shape as the shaded object. Subjects underestimate the shear transformation for shaded objects, and the scaling transformation for textured objects, consistent with the predictions derived from our image statistics analysis. Thus, differences between cues may be predicted by a common front end.

In another task, we applied transformations to texture and shading that elicit illusions of 3D shape. The strength of the illusions correlates with the induced changes in the orientation and scale statistics. Together, these findings suggest that to understand 3D shape perception, it is useful to reformulate the problem in terms of the image measurements made by the front end of vision.

Fleming, R. Li, Y. Adelson, E. (2008). Image statistics for 3D shape estimation [Abstract]. Journal of Vision, 8(6):76, 76a, http://journalofvision.org/8/6/76/, doi:10.1167/8.6.76. [CrossRef]
Footnotes
 RF supported by DFG grant 624/1-1.
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×