[R] Why can Llama-3 work with 32K context if it only had 8K context length?

Hello folks! See post here: [https://twitter.com/abacaj/status/1785147493728039111](https://twitter.com/abacaj/status/1785147493728039111)

I didn't understand what he meant by "with zero-training (actually just a simple 2 line config) you can get 32k context out of llama-3 models"

Does someone know what this **dynamic scaling trick** is? Much appreciated! :)

32k context config context dynamic line llama machinelearning scaling simple training trick