DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models

arXiv:2404.14801v1 Announce Type: new
Abstract: A well-executed graphic design typically achieves harmony in two levels, from the fine-grained design elements (color, font and layout) to the overall design. This complexity makes the comprehension of graphic design challenging, for it needs the capability to both recognize the design elements and understand the design. With the rapid development of Multimodal Large Language Models (MLLMs), we establish the DesignProbe, a benchmark to investigate the capability of MLLMs in design. Our benchmark includes eight …

abstract arxiv benchmark capability color complexity cs.cv design fine-grained graphic language language models large language large language models multimodal type