All the Hard Stuff Nobody Talks About when Building Products with LLMs

All the Hard Stuff Nobody Talks About when Building Products with LLMs

Phillip Carter shares lessons learned building LLM features for Honeycomb - hard won knowledge from building a query assistant for turning human questions into Honeycomb query filters.

This is very entertainingly written. "Use Embeddings and pray to the dot product gods that whatever distance function you use to pluck a relevant subset out of the embedding is actually relevant".

Few-shot prompting with examples had the best results out …

ai assistant building embeddings features filters generativeai honeycomb human knowledge lessons learned llm llms products promptengineering promptinjection query questions shares talks