MISC: Ultra-low Bitrate Image Semantic Compression Driven by Large Multimodal Model

arXiv:2402.16749v2 Announce Type: replace
Abstract: With the evolution of storage and communication protocols, ultra-low bitrate image compression has become a highly demanding topic. However, existing compression algorithms must sacrifice either consistency with the ground truth or perceptual quality at ultra-low bitrate. In recent years, the rapid development of the Large Multimodal Model (LMM) has made it possible to balance these two goals. To solve this problem, this paper proposes a method called Multimodal Image Semantic Compression (MISC), which consists of …

arxiv compression cs.ai cs.cv eess.iv image low misc multimodal multimodal model semantic type