[R] Meta researchers present method for decoding speech from brain waves

Researchers at Meta trained a deep learning model on brain recordings and audio data from 169 people listening to speech. Their method achieves up to 73% accuracy at identifying a 3-second clip of speech from non-invasive EEG or MEG scans.

This is a massive improvement over previous attempts at decoding speech from neural signals. It approaches the performance of studies using implanted electrodes.

The key innovations:

* A contrastive loss function that aligns latent speech and brain representations
* Leveraging …

accuracy audio brain clip data decoding deep learning eeg improvement machinelearning massive meg meta meta researchers people researchers scans speech