MiniGPT-4

MiniGPT-4

An incredible project with a poorly chosen name. A team from King Abdullah University of Science and Technology in Saudi Arabia combined Vicuna-13B (a model fine-tuned on top of Facebook's LLaMA) with the BLIP-2 vision-language model to create a model that can conduct ChatGPT-style conversations around an uploaded image. The demo is very impressive, and the weights are available to download - 45MB for MiniGPT-4, but you'll need the much larger Vicuna and LLaMA weights as well.

Via Hacker …

ai chatgpt conversations demo download facebook generativeai homebrewllms image language language model llama llms minigpt minigpt-4 project saudi arabia science science and technology team technology university vicuna vision