BYOL-S: Learning Self-supervised Speech Representations by Bootstrapping. (arXiv:2206.12038v4 [cs.SD] UPDATED)

Methods for extracting audio and speech features have been studied since
pioneering work on spectrum analysis decades ago. Recent efforts are guided by
the ambition to develop general-purpose audio representations. For example,
deep neural networks can extract optimal embeddings if they are trained on
large audio datasets. This work extends existing methods based on
self-supervised learning by bootstrapping, proposes various encoder
architectures, and explores the effects of using different pre-training
datasets. Lastly, we present a novel training framework to come …

arxiv bootstrapping speech