InternLM2 Technical Report

arXiv:2403.17297v1 Announce Type: new
Abstract: The evolution of Large Language Models (LLMs) like ChatGPT and GPT-4 has sparked discussions on the advent of Artificial General Intelligence (AGI). However, replicating such advancements in open-source models has been challenging. This paper introduces InternLM2, an open-source LLM that outperforms its predecessors in comprehensive evaluations across 6 dimensions and 30 benchmarks, long-context modeling, and open-ended subjective evaluations through innovative pre-training and optimization techniques. The pre-training process of InternLM2 is meticulously detailed, highlighting the preparation …

abstract agi artificial artificial general intelligence arxiv benchmarks chatgpt cs.ai cs.cl dimensions discussions evolution general gpt gpt-4 however intelligence language language models large language large language models llm llms open-source models paper report technical type