[D] What Are the Fundamental Drawbacks of Mamba Compared to Transformers?

Hello!

I've been pondering this question for some time. To clarify, I'm not referring to aspects like "it hasn't been tested extensively," "its scalability is uncertain," or "there's a lack of industry infrastructure." Instead, I'm interested in understanding the core differences between the transformer and Mamba architectures, specifically how these differences may place Mamba at a disadvantage compared to Transformers.

Best regards!

architectures core differences hello industry infrastructure machinelearning mamba question scalability transformer transformers uncertain understanding