December 2001
Volume 1, Issue 3
Vision Sciences Society Annual Meeting Abstract  |   December 2001
Training-based method for low-level vision problems
Author Affiliations
  • W. Freeman
    Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA
  • E. Pasztor
    Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA
Journal of Vision December 2001, Vol.1, 469. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      W. Freeman, E. Pasztor; Training-based method for low-level vision problems. Journal of Vision 2001;1(3):469.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

We describe a training-based method applicable for various low-level vision problems of estimating scenes from images. The scene quantities to be estimated might be projected object velocities, surface shapes and reflectance patterns, or missing high frequency details. The input image data can be one picture or several from a sequence. We first generate a synthetic world of scenes and their corresponding rendered images, storing about 100,000 pairs of example local image and scene patches in a training database. Given an image to analyze, for each local image patch, we find from the training database a set of candidate scene interpretations consistent with the local image. We model the probabilistic relationship between neighboring scene patches as a Markov network, assigning one node to each scene patch. To specify the compatibility between scene candidates at neighboring nodes, we use overlapping scene patches, and assign compatibilities based on the agreement between scene values in the region of overlap. Finally, we use Bayesian belief propagation, a local, message-passing algorithm, to infer a best scene interpretation at each image patch. The training data provides candidate scene interpretations at each location; the belief propagation integrates this local evidence to form a single, best scene interpretation. We illustrate this approach for the problem of super-resolution (estimating missing high frequency details from a low-resolution image), showing good results on natural images. For the motion estimation problem in a “blobs world”, we show figure/ground discrimination, solution of the aperture problem, and filling-in arising from application of the same probabilistic machinery.

Freeman, W., Pasztor, E.(2001). Training-based method for low-level vision problems [Abstract]. Journal of Vision, 1( 3): 469, 469a,, doi:10.1167/1.3.469. [CrossRef]

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.