Gull: A Generative Multifunctional Audio Codec

arXiv:2404.04947v1 Announce Type: cross
Abstract: We introduce Gull, a generative multifunctional audio codec. Gull is a general purpose neural audio compression and decompression model which can be applied to a wide range of tasks and applications such as real-time communication, audio super-resolution, and codec language models. The key components of Gull include (1) universal-sample-rate modeling via subband modeling schemes motivated by recent progress in audio source separation, (2) gain-shape representations motivated by traditional audio codecs, (3) improved residual vector quantization …

abstract applications arxiv audio codec communication components compression cs.ai cs.lg cs.sd eess.as eess.sp general generative key language language models neural audio compression rate real-time real-time communication resolution sample tasks the key type universal