How Developers Gave Llama 3 More Memory

Developers have been praising Meta Platforms’ Llama 3, the latest version of its flagship large language model. But, as my colleague Stephanie and I explained, they have one big criticism: Llama 3’s context window is too short, at just over 8,000 tokens. (As a refresher, a context window is how much information a model can accept in a single query and a token is a word or part of a word.)

Meta told developers that it expected to release …

big context context window developers explained information language language model large language large language model latest llama llama 3 memory meta meta platforms platforms tokens