Long context prompting for Claude 2.1

Long context prompting for Claude 2.1

Claude 2.1 has a 200,000 token context, enough for around 500 pages of text. Convincing it to answer a question based on a single sentence buried deep within that content can be difficult, but Anthropic found that adding "Assistant: Here is the most relevant sentence in the context:" to the end of the prompt was enough to raise Claude 2.1’s score from 27% to 98% on their evaluation.

ai anthropic assistant claude claude 2 claude 2.1 context found generativeai llms promptengineering prompting text token