MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning

arXiv:2311.10774v2 Announce Type: replace
Abstract: With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains in the domain of chart image understanding due to the distinct abstract components in charts. To address this, we introduce a large-scale MultiModal Chart Instruction (\textbf{MMC-Instruction}) dataset comprising 600k instances supporting diverse tasks and chart types. Leveraging this data, we develop MultiModal …

arxiv cs.ai cs.cl multimodal scale type understanding