all AI news
Why Long Context Windows in LLMs can be deceptive (Lost in the Middle problem)
DEV Community dev.to
It seems like OpenAI and Anthropic have been in a battle of context windows for the better part of a year.
In May of 2023, Anthropic breathlessly announced: "We've expanded Claude's context window from 9K to 100K tokens, corresponding to around 75,000 words!"
(Note: 75,000 words is about 300 pages)
Not to be outdone, OpenAI released its 128K context window in November 2023.
Only then to be outnumbered by Anthropic's 200k context window in March 2024.
Is this back and …
ai anthropic beginners claude context context window context windows llms lost openai part productivity python tokens windows words