Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

arXiv:2403.05530v1 Announce Type: new
Abstract: In this report, we present the latest model of the Gemini family, Gemini 1.5 Pro, a highly compute-efficient multimodal mixture-of-experts model capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. Gemini 1.5 Pro achieves near-perfect recall on long-context retrieval tasks across modalities, improves the state-of-the-art in long-document QA, long-video QA and long-context ASR, and matches or surpasses Gemini 1.0 Ultra's …

abstract arxiv compute context cs.ai cs.cl documents experts family fine-grained gemini gemini 1.5 gemini 1.5 pro information multimodal multiple reasoning report tokens type understanding video