A spatio-temporal Graph Neural Network for EEG Emotion Recognition Based on Regional and Global Brain

Xiaoliang Wang1, 2, Chuncao Li1, 2, Yuzhen Liu1, 2, Wei Liang1, 2, Kuanching Li1, 2 and Aneta Poniszewska-Maranda3

  1. School of Computer Science and Engineering, Hunan University of Science and Technology
    Xiangtan 411201, China
  2. Sanya Research Institute, Hunan University of Science and Technology
    Sanya 572024, China
    {fengwxl, wliang, aliric}@hnust.edu.cn, lichuncao2008@163.com, yzhenliu@126.com
  3. Institute of Information Technology, Lodz University of Technology
    Lodz, Poland
    aneta.poniszewska-maranda@p.lodz.pl

Abstract

Effective emotion recognition based on electroencephalography (EEG) is crucial for the development of Brain-Computer Interface (BCI). Neuroscientific studies highlight the importance of localized brain activity analysis for understanding emotional states. However, existing deep learning methods often fail to extract spatio-temporal features of EEG signals adequately. Accordingly, we propose a novel spatio-temporal graph neural network, MSL-TGNN, by integrating local and global brain information. A multi-scale temporal learner is designed to extract EEG temporal dependencies. And a brain region learning block and an extended global graph attention network are introduced to explore the spatial features. Specifically, the brain region learning block aggregates local channel information, whereas the extended global graph attention network can effectively capture nonlinear dependencies among regions to extract global brain information. We conducted subject-dependent and subject-independent experiments on the DEAP dataset, and the results indicate that our proposed model outperforms compared to state-of-the-art methods.

Key words

Bidirectional gated recurrent unit, EEG emotion recognition, graph attention network, multi-dimensional attention, deep learning

How to cite

Wang, X., Li, C., Liu, Y., Liang, W., Li, K., Poniszewska-Maranda, A.: A spatio-temporal Graph Neural Network for EEG Emotion Recognition Based on Regional and Global Brain. Computer Science and Information Systems