September 2015
Volume 15, Issue 12
Vision Sciences Society Annual Meeting Abstract  |   September 2015
Visual Classification Expertise without Training
Author Affiliations
  • Brett Roads
    Department of Computer Science and Institute of Cognitive Science, University of Colorado Boulder
  • Michael Mozer
    Department of Computer Science and Institute of Cognitive Science, University of Colorado Boulder
Journal of Vision September 2015, Vol.15, 1172. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Brett Roads, Michael Mozer; Visual Classification Expertise without Training. Journal of Vision 2015;15(12):1172. doi:

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Decision-support systems have been built to assist individuals in categorizing a visual stimulus by presenting the stimulus next to two or more reference images with known category labels. Such systems transform the task of categorization into the task of similarity judgment. Decision-support systems are playing an increasing role in diverse applications such as commercial software products, human-in-the-loop computer vision, and citizen science projects. To explore the capabilities of decision support, Mechanical Turk experiments were devised in which participants make a sequence of similarity judgments between a test exemplar and four reference exemplars. Experiment 1 used rectangles that vary along the dimensions of width and height. Judgments from this experiment were used to select and parameterize a model of human forced-choice selection. This model was used to optimize the choice of reference exemplars for specific categorization tasks. Experiment 2 evaluated implicit classification accuracy on three different categorization tasks, each corresponding to a different decision boundary in the 2D space of rectangles—vertical, horizontal, and diagonal. High classification accuracy (M = 91%, SD = 2%) was achieved even though the three implicit tasks were intermixed and subjects had no awareness that they were performing specific categorization tasks. (From their perspective, the task was similarity judgment.) Through intelligent selection of exemplars, naïve individuals can be guided to make correct classification decisions. Further experiments calibrated the forced-choice selection model—and the reference exemplars chosen based on this model—to individual participants and used more complex and naturalistic stimuli, yielding further encouraging results.

Meeting abstract presented at VSS 2015


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.