Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models

arXiv:2404.15271v1 Announce Type: new
Abstract: Recent advancements in instruction-following models have made user interactions with models more user-friendly and efficient, broadening their applicability. In graphic design, non-professional users often struggle to create visually appealing layouts due to limited skills and resources. In this work, we introduce a novel multimodal instruction-following framework for layout planning, allowing users to easily arrange visual elements into tailored layouts by specifying canvas size and design purpose, such as for book covers, posters, brochures, or menus. …

abstract arxiv create cs.ai cs.cl cs.cv design documents framework graphic interactions multimodal novel planning professional resources skills struggle type work