October 2020
Volume 20, Issue 11
Open Access
Vision Sciences Society Annual Meeting Abstract  |   October 2020
What do leave-one-person-out pattern analyses really tell us about the neural representation of visual object symmetries?
Author Affiliations & Notes
  • Fernando M. Ramirez
    Laboratory of Brain and Cognition, NIMH
  • Cambria Revsine
    Laboratory of Brain and Cognition, NIMH
  • Elisha P. Merriam
    Laboratory of Brain and Cognition, NIMH
  • Footnotes
    Acknowledgements  This work was supported by the Intramural Research Program at NIMH. We thank Chris Baker, Steve Gotts, and Alex Martin for useful comments and suggestions.
Journal of Vision October 2020, Vol.20, 1445. doi:https://doi.org/10.1167/jov.20.11.1445
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Fernando M. Ramirez, Cambria Revsine, Elisha P. Merriam; What do leave-one-person-out pattern analyses really tell us about the neural representation of visual object symmetries?. Journal of Vision 2020;20(11):1445. https://doi.org/10.1167/jov.20.11.1445.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

A key challenge in human neuroscience is to gain information about neural population codes using indirect measures of neural activity. Recently, a multivariate pattern analysis method termed Leave-One-Person-Out (LOPO) has been used to support inferences regarding neural coding. Two key caveats, however, have been overlooked by users of this method: (1) its sensitivity to low-level feature imbalances across conditions (e.g. image contrast, luminance, and their variability over instances of each stimulus class), and (2) implausibility of the methods’ assumption that spatial normalization meaningfully aligns neural patterns of activation across subjects. Here, we show with simulations instantiating multilayered randomly connected feedforward networks that LOPO leads to erroneous conclusions when the methods’ assumptions are not met. In particular, low-level properties of the images chosen by an experimenter are shown to largely determine the observed pattern of results, and not the covariance structure of the underlying spatial patterns of activation. We further show how deceptively complex representational structures emerge due to specifics of the LOPO analysis scheme. Interestingly, simulations initially intended to study the general behavior of LOPO led to concrete predictions regarding the relative norms, means and variances of images from an image database recently used in multiple recent neuroimaging studies. Low-level feature imbalances of the precise form predicted by our model were confirmed by ensuig direct analyses of these images. We argue that under plausible assumptions regarding the fMRI measurement process, the observed confounds may account for recent putative evidence of mirror-symmetric tuning of neural populations in a human face-selective area. In sum, we conclude that (1) LOPO is particularly sensitive to low-level image feature imbalances across conditions, and (2) the method’s sound interpretation hinges on implausible assumptions. Our observations cast doubts on the validity of LOPO analyses to support inferences that require the detection of spatially structured brain patterns.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×