s
Nov. 16, 2023, 4:42 p.m. |

Simon Willison's Weblog simonwillison.net

tldraw/draw-a-ui


Absolutely spectacular GPT-4 Vision API demo. Sketch out a rough UI prototype using the open source tldraw drawing app, then select a set of components and click "Make Real" (after giving it an OpenAI API key). It generates a PNG snapshot of your selection and sends that to GPT-4 with instructions to turn it into a Tailwind HTML+JavaScript prototype, then adds the result as an iframe next to your mockup.

You can then make changes to your mockup, select …

api app click components demo generativeai giving gpt gpt-4 gpt4 gpt-4 vision html javascript llms openai openai api open source opensource set vision

Lecturer in Social Data Analytics

@ The University of Hong Kong | Hong Kong

Applied Scientist - Conversational AI, Analytics and Data Management

@ Amazon.com | Seattle, WA, USA

Senior Perception & Autonomy Researcher

@ Draper | Cambridge, MA, United States

Lead ML & AI Engineer

@ HERE Technologies | Navi Mumbai, India

Data Scientist - Sr. Consultant level ( 9Yrs to 11yrs, TensorFlow , Python,R , Bigdata)

@ Visa | Bengaluru, India

Spatial Data Engineer

@ HERE Technologies | New Cairo, Egypt