Implementing Vision-Powered Chit-Chats with Robots: A GPT-4 Adventure 🤖👀

Hey there! 👋 Imagine a world where your favourite chatbot or social robot isn't just responding to text-based inputs but is also getting a real-time visual sneak peek into the conversation. Exciting, right? Well, we implemented just that with the help of GPT-4, and I'll explain how you can do it too! But first, here's a video showing the final result:

Check out our paper I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robots for more …

adventure chatbot conversation gpt gpt-4 hey llm openai python real-time robot robots social text the conversation tutorial vision visual world