September 2015
Volume 15, Issue 12
Free
Vision Sciences Society Annual Meeting Abstract  |   September 2015
Mouse Saliency - a New Method for Low-Cost Large-Scale Attentional Data Collection
Author Affiliations
  • Ming Jiang
    Department of Electrical and Computer Engineering, National University of Singapore
  • Shengsheng Huang
    Department of Electrical and Computer Engineering, National University of Singapore
  • Juanyong Duan
    Department of Electrical and Computer Engineering, National University of Singapore
  • Qi Zhao
    Department of Electrical and Computer Engineering, National University of Singapore
Journal of Vision September 2015, Vol.15, 221. doi:10.1167/15.12.221
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Ming Jiang, Shengsheng Huang, Juanyong Duan, Qi Zhao; Mouse Saliency - a New Method for Low-Cost Large-Scale Attentional Data Collection. Journal of Vision 2015;15(12):221. doi: 10.1167/15.12.221.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Eye tracking is commonly used in visual neuroscience and cognitive science to answer related questions such as visual attention and decision making. We envision that bigger eye-tracking data can advance the understanding of these questions due to the inherently complex nature of both the stimuli and the human cognitive process. The scale of current eye-tracking experiments, however, are limited as it requires a customized device to track gazes accurately. Low-cost data collection with general-purpose webcams is not yet accurate enough, especially in uncontrolled environments. We present a new method to allow the collection of large-scale attentional data using a gaze-contingent multi-resolutional mechanism. Subjects can move the mouse to direct the high-resolutional fovea to where they find interesting in the image stimuli. The stimuli encoded the visual acuity drop-off as a function of retinal eccentricity. The mouse-contingent paradigm motivated mouse movements, to reveal interesting objects in the periphery with high resolution, similarly as humans shift their gazes to bring objects-of-interest to the fovea. The mouse trajectories from multiple subjects were aggregated to indicate where people look most in the images. The new paradigm allowed using a general-purpose mouse instead of an expensive eye tracker to record viewing behaviours, thus enabling large-scale attentional data collection. We propose a crowdsoucing mechanism to collect mouse-tracking data through Amazon Mechanic Turk, and a proof-of-concept dataset of 60 subjects “free-viewing” 10,000 images from the recent Microsoft COCO dataset. The crowdsourcing allowed us to easily collect and compare various data with different top-down instructions. Our results suggested that the large-scale mouse-tracking data were much more similar to the eye-tracking data than those predicted from the state-of-the-art computational saliency models. They were also shown to be a good source as ground truth for the evaluation of saliency algorithms.

Meeting abstract presented at VSS 2015

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×