Design2Code: How Far Are We From Automating Front-End Engineering?

arXiv:2403.03163v1 Announce Type: cross
Abstract: Generative AI has made rapid advancements in recent years, achieving unprecedented capabilities in multimodal understanding and code generation. This can enable a new paradigm of front-end development, in which multimodal LLMs might directly convert visual designs into code implementations. In this work, we formalize this as a Design2Code task and conduct comprehensive benchmarking. Specifically, we manually curate a benchmark of 484 diverse real-world webpages as test cases and develop a set of automatic evaluation metrics …

abstract arxiv capabilities code code generation cs.cl cs.cv cs.cy designs development engineering front-end generative llms multimodal new paradigm paradigm type understanding visual work