March 29, 2024, 8:41 p.m. | /u/Amgadoz

Machine Learning www.reddit.com

TL;DR: What are the best practices for deploying and using embedding models?


There are 69 packages for deploying LLMs (the one you chat with) with more coming up every week.

However, I haven't seen any package or framework for efficiently serving embedding models like gte-large in production.

best practices chat deploy embedding embedding models every framework however llms machinelearning package practices production

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US