September 2024
Volume 24, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2024
An intracranial EEG Natural Scenes Dataset to integrate electrophysiology with fMRI
Author Affiliations & Notes
  • Harvey Huang
    Mayo Clinic
  • Zeeshan Qadir
    Mayo Clinic
  • Morgan Montoya
    Mayo Clinic
  • Michael Jensen
    Mayo Clinic
  • Gabriela Ojeda Valencia
    Mayo Clinic
  • Kai Miller
    Mayo Clinic
  • Gregory Worrell
    Mayo Clinic
  • Kendrick Kay
    University of Minnesota
  • Dora Hermes
    Mayo Clinic
  • Footnotes
    Acknowledgements  We thank the patients in this study for their participation, Cindy Nelson and Karla Crockett for their assistance, and Peter Brunner for support with BCI2000. Research reported in this publication was supported by the NEI (R01EY035533, R01EY023384) and the NIGMS (T32GM145408).
Journal of Vision September 2024, Vol.24, 967. doi:https://doi.org/10.1167/jov.24.10.967
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Harvey Huang, Zeeshan Qadir, Morgan Montoya, Michael Jensen, Gabriela Ojeda Valencia, Kai Miller, Gregory Worrell, Kendrick Kay, Dora Hermes; An intracranial EEG Natural Scenes Dataset to integrate electrophysiology with fMRI. Journal of Vision 2024;24(10):967. https://doi.org/10.1167/jov.24.10.967.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Human brain networks involved in visual perception have been extensively investigated with fMRI studies such as the Natural Scenes Dataset (NSD), in which 8 healthy participants viewed thousands of naturalistic images. However, spectro-temporal characteristics are limited in fMRI. In contrast, intracranial EEG (iEEG) boasts sub-millisecond resolution and meaningful spectral power changes, but is limited by sparse spatial sampling. By collecting a large, high-quality iEEG dataset with matching stimuli to an fMRI dataset, we enable integration of the two modalities to leverage benefits of both. We recorded iEEG data in 12 human participants implanted for epilepsy monitoring, while they viewed the same 1000 stimuli presented to the NSD-fMRI participants. At each electrode, broadband power was calculated as a measure of local neuronal activity. Electrodes with significant signal-to-noise ratio across 6 repetitions of a 100-stimuli subset were considered visually responsive. Of 1650 total electrodes, 92 were visually responsive: 16 early visual, 10 lateral occipital, 5 dorsal occipital, 31 ventral temporal, 6 lateral temporal, 2 temporal pole, 18 frontal, 2 cingulate, and 2 amygdala. To integrate the iEEG and fMRI datasets, broadband power at each electrode was correlated with fMRI beta weights at all vertices across stimuli, yielding brain-wide correlation maps. 73 electrodes exhibited significantly positive correlations with fMRI vertices within a 3 mm radius, indicating robust local correspondence. Globally, most electrodes showed one of five spatial correlation patterns, which each consisted of positive and negative correlations across early visual areas and ventral, lateral, and dorsal streams; and which showed preference for contrast, places, faces, food, and bodies. This novel dataset integrates iEEG and fMRI on the same set of naturalistic stimuli. The recorded iEEG activity correlates well with fMRI and reveals global patterns of stimulus preference. This dataset opens the door to time-frequency analyses that can elucidate high-resolution dynamics within these networks.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×