MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models. (arXiv:2304.10592v1 [cs.CV])

The recent GPT-4 has demonstrated extraordinary multi-modal abilities, such
as directly generating websites from handwritten text and identifying humorous
elements within images. These features are rarely observed in previous
vision-language models. We believe the primary reason for GPT-4's advanced
multi-modal generation capabilities lies in the utilization of a more advanced
large language model (LLM). To examine this phenomenon, we present MiniGPT-4,
which aligns a frozen visual encoder with a frozen LLM, Vicuna, using just one
projection layer. Our findings reveal …

advanced arxiv encoder features gpt gpt-4 images language language model language models language understanding large language model large language models lies llm minigpt minigpt-4 projection text understanding vicuna vision websites