Nov. 28, 2023, 5:37 p.m. | /u/Noddybear

Machine Learning www.reddit.com

I'm a contributor to [Tanuki](https://github.com/Tanuki/tanuki.py), a project that allows you to declaratively define LLM behaviour using test-driven syntax in Python.

By specifying the contract that an LLM has to fulfil as a test, it helps cut down on MLOps and enables you to align the behaviour of your model to your requirements using a standard dev-ops process.

Additionally, these align statements facilitate automatic teacher-student model distillation to reduce cost and latency by up to 10x (see benchmarks).

Any thoughts or …

benchmarks cost dev distillation latency llm machinelearning mlops model distillation ops process reduce requirements standard test thoughts

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US