[R] Introducing SSAMBA: The Self-Supervised Audio Mamba!

Hey Reddit,

Tired of transformers? Is attention really all you need? Meet SSAMBA (Self-Supervised Audio Mamba)! 🐍✨

This attention-free, purely state-space model (SSM)-based, self-supervised marvel doesn’t just hiss—it roars! SSAMBA achieves better or similar performance to its transformer-based counterparts (SSAST) on tasks like speaker identification, keyword spotting, and audio classification. But here's the kicker: it’s much more GPU memory efficient and quicker at inference, especially with longer audio lengths.

Curious? Check out the full paper here: [SSAMBA on arXiv](https://arxiv.org/abs/2405.11831)

Thanks …

attention audio classification free hey identification machinelearning mamba marvel performance reddit space speaker speaker identification ssm state tasks transformer transformers