August 2023
Volume 23, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   August 2023
Serial Dependence Biases Realistic Skin Cancer Diagnosis
Author Affiliations & Notes
  • Zhihang Ren
    University of California, Berkeley
  • Xinyu Li
    University of California, Berkeley
  • Dana Pietralla
    University of Cologne
  • Mauro Manassi
    University of Aberdeen
  • Stella Yu
    University of California, Berkeley
    University of Michigan, Ann Arbor
  • David Whitney
    University of California, Berkeley
  • Footnotes
    Acknowledgements  This work has been supported by National Institutes of Health (NIH) under grant #R01CA236793.
Journal of Vision August 2023, Vol.23, 5625. doi:https://doi.org/10.1167/jov.23.9.5625
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Zhihang Ren, Xinyu Li, Dana Pietralla, Mauro Manassi, Stella Yu, David Whitney; Serial Dependence Biases Realistic Skin Cancer Diagnosis. Journal of Vision 2023;23(9):5625. https://doi.org/10.1167/jov.23.9.5625.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Serial Dependence is a perceptual phenomenon in which the visual system tends to bias representations toward recent visual history (Fischer & Whitney, 2014; Cicchini, et al., 2014). Studies under both lab and naturalistic scenarios have shown that radiologists’ perception is influenced by serial dependence, which could have a negative impact on diagnostic accuracy (Manassi et al., 2019; Manassi et. al., 2021; Ren et. al., 2022). However, those studies often suffer from a dearth of expert participants; typically, less than 20 experts are recruited per experiment. In this study, we analyzed a large volume of diagnostic data from a commercially available mobile app. All of the 7,798 skin cancer images used were genuine and were retrieved from either public databases or medical clients and were randomly selected and randomly ordered for each participant. In total, 756,001 diagnostic judgments from 1,137 medical students and residents were analyzed. We found an effect of serial dependence, such that judgments on the current image were pulled toward the observer's previous experience. Importantly, this effect displayed both feature-tuning and temporal-tuning, two of the diagnostic criteria of serial dependence. With respect to feature-tuning, although the sequential images were completely random, there was stronger serial dependence when two medical images happened to be similar in severity (estimated based on popularity vote). Utilizing a semantic similarity metric in deep learning, we also found larger serial dependence effects when two skin cancer images were, by chance, semantically similar. We also found that shorter inter-trial intervals led to stronger serial dependence, suggesting a kind of temporal tuning of the effect. This study suggests that serial dependence may negatively impact skin cancer diagnoses in a realistic diagnostic scenario. It also hints at the possible methods in which these biases can be mitigated.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×