May 10, 2024, 10:26 a.m. | /u/kiockete

Machine Learning www.reddit.com

What is there to "discretize"? Isn't the signal / sequence already "discrete" in the form of tokens? Please don't send me over to wikipedia article about "Discretization of linear state space models ", because I cannot draw any connection to LLMs. It seems to me that Mamba at its core is just EMA with dynamic alpha parameter that is calculated from the current token at time t for each channel. Don't quite understand what is the benefit of "discretization" and …

article core earth form isn linear llms machinelearning mamba signal space state state space models tokens wikipedia

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US