PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Model

arXiv:2404.03836v1 Announce Type: new
Abstract: Recent advancements in 3D perception systems have significantly improved their ability to perform visual recognition tasks such as segmentation. However, these systems still heavily rely on explicit human instruction to identify target objects or categories, lacking the capability to actively reason and comprehend implicit user intentions. We introduce a novel segmentation task known as reasoning part segmentation for 3D objects, aiming to output a segmentation mask based on complex and implicit textual queries about specific …

arxiv cs.ai cs.cv multimodal multimodal model part reasoning segmentation type