March 29, 2024, 8:41 p.m. | /u/Amgadoz

Machine Learning www.reddit.com

TL;DR: What are the best practices for deploying and using embedding models?


There are 69 packages for deploying LLMs (the one you chat with) with more coming up every week.

However, I haven't seen any package or framework for efficiently serving embedding models like gte-large in production.

best practices chat deploy embedding embedding models every framework however llms machinelearning package practices production

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote