VISION2UI: A Real-World Dataset with Layout for Code Generation from UI Designs

arXiv:2404.06369v1 Announce Type: new
Abstract: Automatically generating UI code from webpage design visions can significantly alleviate the burden of developers, enabling beginner developers or designers to directly generate Web pages from design diagrams. Currently, prior research has accomplished the objective of generating UI code from rudimentary design visions or sketches through designing deep neural networks. Inspired by the groundbreaking advancements achieved by Multimodal Large Language Models (MLLMs), the automatic generation of UI code from high-fidelity design images is now emerging …

arxiv code code generation cs.ai cs.cv cs.se dataset designs type world