Dec. 5, 2023, 6:38 p.m. | /u/kindly_formation71

Machine Learning www.reddit.com

Ran an experiment comparing information retrieval performance between Open AI's Assistants API's RAG, GPT-4 Turbo (with context window stuffing) and Llama Index with GPT4.

I recently added a new **document-oriented** react hook to [CopilotKit](https://github.com/RecursivelyAI/CopilotKit), made specifically to accommodate (potentially long-form) documents and wanted to get the best performance.

**Got pretty striking results:** The assistant's API beats Llama index in a big way in performance and is 25x cheaper than context window stuffing with GPT-4 Turbo.



[accuracy performance](https://preview.redd.it/to7d2oqiti4c1.jpg?width=1456&format=pjpg&auto=webp&s=2481940f6e07bb027a1bb744e8e48ecc7d374b81)



[costs](https://preview.redd.it/b7c7xltjti4c1.jpg?width=1456&format=pjpg&auto=webp&s=0f33be91986569f58e197d769a8b9b9d483b01f7) …

api assistant assistants big context context window cost experiment gpt gpt-4 gpt4 haystack index information llama machinelearning open ai performance rag retrieval turbo

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

IT Commercial Data Analyst - ESO

@ National Grid | Warwick, GB, CV34 6DA

Stagiaire Data Analyst – Banque Privée - Juillet 2024

@ Rothschild & Co | Paris (Messine-29)

Operations Research Scientist I - Network Optimization Focus

@ CSX | Jacksonville, FL, United States

Machine Learning Operations Engineer

@ Intellectsoft | Baku, Baku, Azerbaijan - Remote

Data Analyst

@ Health Care Service Corporation | Richardson Texas HQ (1001 E. Lookout Drive)