Generating Visual Stimuli from EEG Recordings using Transformer-encoder based EEG encoder and GAN

arXiv:2402.10115v1 Announce Type: cross
Abstract: In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to recreate images belonging to various object categories by leveraging EEG recordings obtained while subjects view those images. To achieve this, we employ a Transformer-encoder based EEG encoder to produce EEG encodings, which serve as inputs to the generator component of …

abstract adversarial arxiv brain challenge cs.ai cs.lg decoding deep learning deep learning framework eeg eess.sp encoder framework gan images modern q-bio.nc research study transformer type visual