A predictive learning model can simulate temporal dynamics and context effects found in neural representations of continuous speech

arXiv:2405.08237v1 Announce Type: new
Abstract: Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this temporal processing. In this study, we simulated similar analyses with representations extracted from a computational model that was trained on unlabelled speech with the learning objective of predicting upcoming acoustics. Our simulations revealed temporal dynamics similar to those in brain signals, implying that these properties …

abstract arxiv cognitive context continuous cs.cl cs.sd dynamics eess.as effects encoding found humans neuroscience perception predictive processing speech study temporal type work