all AI news
[R] New Python packages to optimise LLMs
April 13, 2024, 10:10 a.m. | /u/AstraMindAI
Machine Learning www.reddit.com
The first is [BitMat](https://github.com/astramind-ai/BitMat), **designed to optimise matrix multiplication** operations using custom Triton kernels. Our package exploits the principles outlined in the "1bit-LLM Era" document.
The second is [Mixture-of-depths](https://github.com/astramind-ai/Mixture-of-depths) an **implementation of Google DeepMind paper: 'Mixture-of-Depths: Dynamically Allocating the compute in transformer-based language models'**, which introduces a new approach to managing computational resources in transformer-based language models.
Let us know what …
More from www.reddit.com / Machine Learning
[D] software to design figures
10 hours ago |
www.reddit.com
[Discussion] Should I go to ICML and present my paper?
1 day, 4 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Lead Data Modeler
@ Sherwin-Williams | Cleveland, OH, United States