Dec. 5, 2023, 6:38 p.m. | /u/kindly_formation71

Machine Learning

Ran an experiment comparing information retrieval performance between Open AI's Assistants API's RAG, GPT-4 Turbo (with context window stuffing) and Llama Index with GPT4.

I recently added a new **document-oriented** react hook to [CopilotKit](, made specifically to accommodate (potentially long-form) documents and wanted to get the best performance.

**Got pretty striking results:** The assistant's API beats Llama index in a big way in performance and is 25x cheaper than context window stuffing with GPT-4 Turbo.

[accuracy performance](

[costs]( …

api assistant assistants big context context window cost experiment gpt gpt-4 gpt4 haystack index information llama machinelearning open ai performance rag retrieval turbo

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

IT Commercial Data Analyst - ESO

@ National Grid | Warwick, GB, CV34 6DA

Stagiaire Data Analyst – Banque Privée - Juillet 2024

@ Rothschild & Co | Paris (Messine-29)

Operations Research Scientist I - Network Optimization Focus

@ CSX | Jacksonville, FL, United States

Machine Learning Operations Engineer

@ Intellectsoft | Baku, Baku, Azerbaijan - Remote

Data Analyst

@ Health Care Service Corporation | Richardson Texas HQ (1001 E. Lookout Drive)