[D] Llama-3 (7B and 70B) on a medical domain benchmark

Llama-3 is making waves in the AI community. I was curious how it will perform in the medical domain, Here are the evaluation results for Llama-3 (7B and 70B) on a medical domain benchmark consisting of 9 diverse datasets

​

https://preview.redd.it/t7cqlkyt9avc1.png?width=1474&format=png&auto=webp&s=bb053d032093dd09c892a3fb570b3eb40a8a288c

I'll be fine-tuning, evaluating & releasing Llama-3 & different LLMs over the next few days on different Medical and Legal benchmarks. Follow the updates here: [https://twitter.com/aadityaura](https://twitter.com/aadityaura)

​

https://preview.redd.it/9egbcayv9avc1.png?width=1344&format=png&auto=webp&s=436a972421d5568e1a544962b8cfd1c7b14efe04

​

​

70b ai community benchmark community datasets diverse domain evaluation llama machinelearning making medical results will