Meta's Llama 2 Long: Longer memory, Handles Heftier Tasks

With positional encoding tweaks and continual pretraining, the new open source Llama 2 Long now excels at long inputs

continual encoding llama llama 2 llama 2 long memory meta open source positional encoding tasks