[D] So, Mamba vs. Transformers... is the hype real?

Heard all the buzz about Mamba, the new kid on the sequence modeling block. Supposedly it's faster, handles longer sequences better, and even outperforms Transformers on some tasks. But is it really a throne-stealer or just another flash in the pan?

My perception:

Strengths: Mamba boasts efficient memory usage, linear scaling with sequence length, and impressive performance in language and DNA modeling. Plus, it ditches the attention mechanism, potentially paving the way for faster inference.

Weaknesses: Still early days, so …

faster flash kid linear machinelearning mamba memory modeling perception scaling tasks transformers usage