April 13, 2024, 10:10 a.m. | /u/AstraMindAI

Machine Learning www.reddit.com

**Hello everyone!!!** We are a small research group and would like to share with you our latest Python packages.

The first is [BitMat](https://github.com/astramind-ai/BitMat), **designed to optimise matrix multiplication** operations using custom Triton kernels. Our package exploits the principles outlined in the "1bit-LLM Era" document.

The second is [Mixture-of-depths](https://github.com/astramind-ai/Mixture-of-depths) an **implementation of Google DeepMind paper: 'Mixture-of-Depths: Dynamically Allocating the compute in transformer-based language models'**, which introduces a new approach to managing computational resources in transformer-based language models.

Let us know what …

hello llms machinelearning python research small think

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Lead Data Modeler

@ Sherwin-Williams | Cleveland, OH, United States