September 2019
Volume 19, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2019
EEG and fMRI Decoding of Emotional States: Temporal Dynamics and Neural Substrate
Author Affiliations & Notes
  • Ke Bo
    J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
  • Siyang Yin
    J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
  • Yuelu Liu
    Center for Mind and Brain, University of California at Davis
  • Jacob Jenkins
    J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
  • Andreas Keil
    Department of Psychology and the NIMH Center for Emotion and Attention, University of Florida
  • Mingzhou Ding
    J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
Journal of Vision September 2019, Vol.19, 285. doi:https://doi.org/10.1167/19.10.285
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Ke Bo, Siyang Yin, Yuelu Liu, Jacob Jenkins, Andreas Keil, Mingzhou Ding; EEG and fMRI Decoding of Emotional States: Temporal Dynamics and Neural Substrate. Journal of Vision 2019;19(10):285. https://doi.org/10.1167/19.10.285.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Both positive and negative emotional stimuli attract more attentional resources than neutral stimuli. It has been further suggested that negative stimuli evoke faster and stronger neural responses compared to positive stimuli. To date, ERP studies testing this proposition has produced mixed results. Here, we examined this problem by applying multivariate pattern analysis (MVPA) to EEG and fMRI data simultaneously recorded from healthy human subjects viewing pleasant (erotic and happy scenes), unpleasant (disgust and attack scenes), and neutral (household and people scenes) pictures from the IAPS library. On each trial the picture was shown for 1000ms. The inter-trial interval varied randomly from 6000 to 9000ms. Applying the support vector machine (SVM) technique to single-trial EEG and fMRI responses, we decoded pleasant-versus-neutral and unpleasant-versus-neutral emotional states, and found the following results. First, pleasant-versus-neutral decoding became above-chance level at ~180ms after picture onset, whereas unpleasant-versus-neutral decoding became above-chance level at ~240ms, suggesting that the processing of negative information is not prioritized, timing-wise, over positive information. Second, across subcategories of pictures, erotic scenes were the earliest to be decoded, followed by disgust scenes, attack scenes and happy scenes, suggesting that the timing of neural information processing is specific to picture content. Third, both positive and negative emotions were maximally decoded at around 500ms after picture onset, and the maximum EEG decoding accuracy was correlated with fMRI decoding accuracy in ventral visual cortex, suggesting that reentrant projections into ventral visual cortex from higher order emotional structures play a role in generating the neural representations of affective pictures.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×