How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites

arXiv:2404.16821v1 Announce Type: new
Abstract: In this report, we introduce InternVL 1.5, an open-source multimodal large language model (MLLM) to bridge the capability gap between open-source and proprietary commercial models in multimodal understanding. We introduce three simple improvements: (1) Strong Vision Encoder: we explored a continuous learning strategy for the large-scale vision foundation model -- InternViT-6B, boosting its visual understanding capabilities, and making it can be transferred and reused in different LLMs. (2) Dynamic High-Resolution: we divide images into tiles …

arxiv commercial cs.cv gap gpt gpt-4v multimodal multimodal models type