[D] What Is Your LLM Tech Stack in Production?

Curious what everybody is using to implement LLM powered apps for production usage and your experience with these toolings and advice.

This is what I am using for some RAG prototypes I have been building for users in finance and capital markets.

**Pre-processing\ETL:**
Unstructured.io + Spark, Airflow

**Embedding model:**
Cohere Embed v3
Previously using OpenAI Ada but Cohere has significantly better retrieval recall and precision for my use case. Also exploring other open weights embedding models

**Vector Database:**
Elasticsearch previously …

advice airflow apps building capital cohere embed embedding etl experience finance llm machinelearning markets pre-processing processing production rag spark stack tech tech stack unstructured usage