DALLE-2 has a secret language!? | Theories and explanations

DALLE-2 has a secret language? No, it’s rather a secret vocabulary. Let’s see what happens and why the model behaves like this.

SPONSOR: Weights & Biases 👉 https://wandb.me/ai-coffee-break

📺 Diffusion models and GLIDE explained: https://youtu.be/344w5h24-h8
📺 Imagen diffusion model: https://youtu.be/xqDeAz0U-R4

Check out our daily #MachineLearning Quiz Questions: https://www.youtube.com/c/AICoffeeBreak/community

Paper 📜: Daras, Giannis and Alexandros G. Dimakis. “Discovering the Hidden Vocabulary of DALLE-2.” (2022). https://arxiv.org/abs/2206.00169 or https://giannisdaras.github.io/publications/Discovering_the_Secret_Language_of_Dalle.pdf

🔗 Original post by the authors: https://twitter.com/giannis_daras/status/1531693093040230402
Author’s thread addressing critique: https://twitter.com/giannis_daras/status/1532605363232444416
🔗 Josha …

dalle dalle-2 language secret