September 2021
Volume 21, Issue 9
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2021
Revealing the cortical transformations of real-world scenes using dynamic electrode-to-image (DETI) mapping
Author Affiliations & Notes
  • Bruce C. Hansen
    Colgate University, Department of Psychological & Brain Sciences, Neuroscience Program, Hamilton NY
  • Michelle R. Greene
    Bates College, Neuroscience Program, Lewiston, ME
  • David J. Field
    Cornell University, Department of Psychology, Ithaca, NY
  • Footnotes
    Acknowledgements  James S. McDonnell Foundation grant (220020430) to BCH; National Science Foundation grant (1736394) to BCH and MRG.
Journal of Vision September 2021, Vol.21, 2641. doi:https://doi.org/10.1167/jov.21.9.2641
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Bruce C. Hansen, Michelle R. Greene, David J. Field; Revealing the cortical transformations of real-world scenes using dynamic electrode-to-image (DETI) mapping. Journal of Vision 2021;21(9):2641. doi: https://doi.org/10.1167/jov.21.9.2641.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Voxelwise encoding models of BOLD signals offer insight into how information in visual scenes is simultaneously represented in visual cortex. However, a complete understanding of how the brain internalizes visual information requires an understanding of the different transformational states of that information over time. Electroencephalography (EEG) has become a popular technique to understand the nature of those states, but suffers from dipole cancellation, thereby precluding a spatially complete signal of scene information. To circumvent that problem, we present the dynamic electrode-to-image (DETI) mapping procedure. The DETI procedure is an encoder-based approach that capitalizes on the state-space geometry of images and visual evoked potentials (VEPs) to map VEP signals to each location within scene images. Specifically, DETI mapping reduces the dimensionality of VEP signals from different electrodes over time and then maps those signals via a log-Gabor encoding model to each pixel within specific images. We applied this method to data gathered in a standard VEP paradigm whereby participants (n = 24) viewed 80 grayscale scene images (19.5 degrees of visual angle) while undergoing 128-channel EEG. DETI mapping revealed an interesting, possibly two-stage, pattern of transformational states that begin with a low spatial frequency (LSF) state (~50 ms), followed by a high spatial frequency (HSF) state (~70 ms to ~140 ms). Starting around 150 ms, the image transformations undergo what appears to be intermittent LSF transformations at ~180 ms and ~260 ms, possibly indicative of recurrent processes. Further, time-time regression analyses show that local regions within scenes undergo relatively unique spatiotemporal transformations over time, suggesting different temporal stages of local prioritization of scene information. The DETI mapping procedure therefore holds much potential to better understand the spatiotemporal states of visual information, thereby offering insight into how the early visual code shapes and refines higher semantic representations of our visual world.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×