CoReS: Orchestrating the Dance of Reasoning and Segmentation

arXiv:2404.05673v1 Announce Type: new
Abstract: The reasoning segmentation task, which demands a nuanced comprehension of intricate queries to accurately pinpoint object regions, is attracting increasing attention. However, Multi-modal Large Language Models (MLLM) often find it difficult to accurately localize the objects described in complex reasoning contexts. We believe that the act of reasoning segmentation should mirror the cognitive stages of human visual search, where each step is a progressive refinement of thought toward the final object. Thus we introduce the …

arxiv cs.cv dance reasoning segmentation type