Calibration & Reconstruction: Deep Integrated Language for Referring Image Segmentation

arXiv:2404.08281v1 Announce Type: new
Abstract: Referring image segmentation aims to segment an object referred to by natural language expression from an image. The primary challenge lies in the efficient propagation of fine-grained semantic information from textual features to visual features. Many recent works utilize a Transformer to address this challenge. However, conventional transformer decoders can distort linguistic information with deeper layers, leading to suboptimal results. In this paper, we introduce CRFormer, a model that iteratively calibrates multi-modal features in the …

abstract arxiv challenge cs.cv cs.mm features fine-grained image information language lies natural natural language object propagation segment segmentation semantic textual transformer type visual