September 2021
Volume 21, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2021
Comparison of threshold measurements in laboratory and online studies using a Quest+ algorithm
Author Affiliations & Notes
  • Vasiliki Myrodia
    University of Lille, Laboratoire SCALab UMR CNRS 9193
  • Jerome Buisine
    Universite Cote d Opale - LISIC - Laboratoire d Informatique Signal et Image de la Cote d Opale, Calais, France
  • Laurent Madelain
    University of Lille, Laboratoire SCALab UMR CNRS 9193
    Aix Marseille Universite, UMR 7289 CNRS, Institut de Neurosciences de la Timone, Marseille, France
  • Footnotes
    Acknowledgements  Funding from ANR grant ANR-17-CE38-0009
Journal of Vision September 2021, Vol.21, 1959. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Vasiliki Myrodia, Jerome Buisine, Laurent Madelain; Comparison of threshold measurements in laboratory and online studies using a Quest+ algorithm. Journal of Vision 2021;21(9):1959.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Online experiments have become popular and it is useful to test how data collected online compare to data measured in the laboratory. Here we compared perceptual thresholds of the perceived quality of computer-generated images (CGI) in a large-sample (N=174) measured online, and a smaller-sample (N=71) obtained in a laboratory-controlled study. Stimuli were three sets of CGIs picturing different scenes of the interior of an apartment. The algorithm used for generating the images reduces the amount of visual noise when the computation time increases so that each successive image within a set has less noise than the previous one. The last generated image of each set (i.e. with the less visual noise) was used as a reference image (RI) and compared to other images of the set. Each comparison image (CI), was cut randomly and the missing part was replaced by its corresponding part from the RI. On each trial observers had unlimited time to report whether they see a single or a composite image. We used a QUEST+ Bayesian adaptive method, which minimizes the expected Shannon entropy, to choose the next CI after each trial. Perceptual thresholds were expressed relatively to the size of the image set. Although online participants reached a stable threshold in fewer trials than laboratory participants (90 vs 156 trials on average, respectively), the equivalence test (TOST) revealed a significant similarity (p<0.05) between the online and laboratory perceptual thresholds. Online measurements also replicated the effects of the scene (THRESHOLDscene1=0.38, MADscene1=0.12; THRESHOLDscene2=0.35, MADscene2=0.09; THRESHOLDscene3=0.42, MADscene3 =0.08) we observed in the laboratory (THRESHOLDscene1 = 0.39, MADscene1 =0.11; THRESHOLDscene2 = 0.38, MADscene2 =0.09; THRESHOLDscene3 = 0.41, MADscene3 = 0.11). Overall, this study shows consistent data collected online and in the laboratory. Despite strong differences in experimental conditions, online measurement of perceived image quality could accurately substitute the laboratory measurements.


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.