[R] NExT-GPT: Any-to-Any Multimodal LLM - National University of Singapore 2023

Paper: [https://arxiv.org/abs/2309.05519](https://arxiv.org/abs/2309.05519)

Blog: [https://next-gpt.github.io/](https://next-gpt.github.io/)

**My opinion: It lacks a Cognitive Architecture:** [**https://arxiv.org/abs/2309.02427**](https://arxiv.org/abs/2309.02427) **Also the models are far too small and are more on the gpt-2 level. The idea in itself is a good one but can be far improved with bigger models. I also would like to remember in this that all foundation models could be improved if there would be no tokenizers:** [**https://x.com/karpathy/status/1657949234535211009?s=20**](https://x.com/karpathy/status/1657949234535211009?s=20)

Abstract:

>While recently Multimodal Large Language Models (MM-LLMs) have made exciting strides, they mostly fall prey …

abstract humans language language models large language large language models llms machinelearning multimodal multiple people prey through understanding world