September 2019
Volume 19, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2019
Title: Trading off probability and reward in structured lottery tasks
Author Affiliations & Notes
  • Laurence Maloney
    Department of Psychology, New York University
    Center for Neural Science, New York University
  • Mordechai Z Juni
    Department of Psychological & Brain Sciences, University of California, Santa Barbara
  • Denise Bercovitch
    Department of Psychology, New York University
  • Todd M Gureckis
    Department of Psychology, New York University
Journal of Vision September 2019, Vol.19, 144b. doi:https://doi.org/10.1167/19.10.144b
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Laurence Maloney, Mordechai Z Juni, Denise Bercovitch, Todd M Gureckis; Title: Trading off probability and reward in structured lottery tasks. Journal of Vision 2019;19(10):144b. doi: https://doi.org/10.1167/19.10.144b.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

In planning speeded reaching movements where each possible outcome is associated with a reward or penalty, the participant is in effect searching through a large collection of possible movement plans for the one plan that maximizes expected reward. It is plausible that, in searching among movements, observers take advantage of the highly ordered structure of the lotteries: small changes in movement plans in terms of space and time produce small changes in expected value. We developed a structured lottery task involving choice among eleven ordered lotteries, each lottery representing an explicit tradeoff of probability of reward and amount of possible reward, each successive lottery promising a higher probability of winning a smaller amount. In a first experiment we measured the performance of 120 participants each of whom participated in one of four conditions, each condition a different set of ordered lotteries. Each participant made exactly one choice, precluding any contribution of learning or “hill climbing”. We compared human decision performance to ideal performance maximizing expected gain. Overall, participants in different conditions altered their strategy appropriately and their expected winnings were 83% to 90% of the maximum possible. However, across all conditions, participants on average chose lotteries with higher probability of reward but lower potential reward than optimal. The failure was small in monetary terms but highly patterned. In a second experiment, we examined whether an additional 120 participants treated winning itself as an additive intrinsic reward that tipped the tradeoff toward increasing probability of winning at the expense of reward. We rejected this possibility. We conjecture that participants’ failure to maximize expected value is primarily due to a distortion in their use of probability information.

Acknowledgement: LTM: Guggenheim Fellowship, TMG: Intelligence Advanced Research Projects Activity (IARPA) via Department of the Interior (DOI) contract D10PC20023. 
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×