August 2014
Volume 14, Issue 10
Vision Sciences Society Annual Meeting Abstract  |   August 2014
Aggregating multiple judgments in a mixed-strengths signal detection task
Author Affiliations
  • Mordechai Z. Juni
    University of California, Santa Barbara
  • Miguel P. Eckstein
    University of California, Santa Barbara
Journal of Vision August 2014, Vol.14, 1179. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Mordechai Z. Juni, Miguel P. Eckstein; Aggregating multiple judgments in a mixed-strengths signal detection task. Journal of Vision 2014;14(10):1179.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Signal detection accuracy is susceptible to internal, sensory-driven noise and to external, stimulus-driven uncertainty. Combining multiple observers' judgments leads to well-known benefits for optimal integration (Sorkin & Dai, 1994), and lower but comparable benefits for majority-rule aggregation (Eckstein, Das, et al., 2012). However, such theoretical analyses and empirical studies use a signal of a single strength while real-life tasks often present a mixture of signal strengths, which makes some instances of the signal much easier to detect than others (e.g., some mammograms contain very large lumps while others contain very small lumps). Here, we simulated and conducted a detection task with a random mixture of high and low signal strengths. Each observer (N=20) participated alone in two conditions on separate days (counterbalanced). On each trial, observers responded on an 8-point confidence scale whether a Gaussian signal (σ=0.15o) was embedded in white noise (signal present 50% of the time). In the single strength condition, the signal always had 11% contrast (SNR=4). In the mixed strengths condition, half of the signals had 7% contrast (SNR=2.54) while the other half had 16% contrast (SNR=5.81). All observers viewed the same exact stimuli but in randomized order, and their individual d-primes were approximately the same for the two conditions (d'≈1.45). As expected, aggregating judgments across observers leads to higher d-primes; but these higher d-primes are 5% to 10% lower in the mixed strengths condition relative to the single strength condition (depending on the number of judgments that are combined). This is because observers' judgments during signal present trials have a heightened correlation in the mixed strengths condition relative to the single strength condition. These results highlight why the aggregations of judgments for real-life stimuli tend to generate less accuracy benefits than theoretically predicted and typically observed for synthetic stimuli where signal strength is usually constant.

Meeting abstract presented at VSS 2014


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.