Multi Needle in a Haystack

Key Links

• Video
• Code

Overview

Interest in long context LLMs is surging as context windows expand to 1M tokens. One of the most popular and cited benchmarks for long context LLM retrieval is Greg Kamradt's Needle in A Haystack: a fact (needle) is injected into a (haystack) of

benchmarks context context windows expand greg haystack key llm llms popular retrieval tokens windows