December 2012
Volume 12, Issue 14
OSA Fall Vision Meeting Abstract  |   December 2012
Estimating Gray Scale and Color in Natural Images
Author Affiliations
  • Anthony D. D'Antona
    University of Texas at Austin, Austin, TX, USA
  • Jeffrey S. Perry
    University of Texas at Austin, Austin, TX, USA
  • Wilson S. Geisler
    University of Texas at Austin, Austin, TX, USA
Journal of Vision December 2012, Vol.12, 6. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Anthony D. D'Antona, Jeffrey S. Perry, Wilson S. Geisler; Estimating Gray Scale and Color in Natural Images. Journal of Vision 2012;12(14):6.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Evolution and learning guarantee that visual systems will exploit the statistical structure of natural images when performing visual tasks. Thus, understanding which aspects of this statistical structure are incorporated into the human nervous system is a fundamental goal in vision science. We consider the task of estimating missing gray scale or color (R, G or B) values at arbitrary pixel locations in natural images, given the context of available pixel values. First, we measured the relevant statistical information for these tasks in calibrated natural images [1]. We find that the statistical structure is sufficient for surprisingly accurate estimation of missing pixel values. Second, we measured human accuracy for estimating missing gray scale values and compared human accuracy with various simple heuristics (e.g., local average, median, and mode), and with optimal observers that have complete knowledge of the local statistical structure in natural images. We find that human estimates are more accurate than simple heuristics, and they match the performance of an optimal observer that knows the local statistical structure of relative intensities (contrasts). This optimal observer predicts the detailed pattern of human estimation errors and hence places strong constraints on the possible underlying neural mechanisms. However, humans do not reach the performance of an optimal observer that knows statistical structure of absolute intensities, which reflect both local relative intensities and local mean intensity. Also, as predicted from our analyses of natural images, human estimation accuracy is negligibly improved by expanding the context from a local patch to the whole image.

Meeting abstract presented at OSA Fall Vision 2012


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.