Llama 2 on Amazon SageMaker a Benchmark

Benchmark evaluating varying sizes of Llama 2 on a range of Amazon EC2 instance types with different load levels on latency (ms per token), and throughput (tokens per second).

amazon amazon ec2 amazon sagemaker benchmark ec2 huggingface instance latency llama llama 2 llm per sagemaker token tokens types