LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM

arXiv:2404.18203v1 Announce Type: new
Abstract: Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional performance and robustness in low-level vision and quality assessment tasks, this study aims to investigate the feasibility of imparting PCQA knowledge to LMMs through text supervision. To achieve this, we transform quality labels into textual descriptions during the fine-tuning phase, enabling LMMs to derive quality rating …

abstract application arxiv assessment cloud cs.ai cs.cv exploration integration lmm lmms low performance quality robustness studies study tasks type vision