Neural Assembler: Learning to Generate Fine-Grained Robotic Assembly Instructions from Multi-View Images

arXiv:2404.16423v1 Announce Type: new
Abstract: Image-guided object assembly represents a burgeoning research topic in computer vision. This paper introduces a novel task: translating multi-view images of a structural 3D model (for example, one constructed with building blocks drawn from a 3D-object library) into a detailed sequence of assembly instructions executable by a robotic arm. Fed with multi-view images of the target 3D model for replication, the model designed for this task must address several sub-tasks, including recognizing individual components used …

abstract arxiv assembly building computer computer vision cs.cv cs.ro example fine-grained generate image images library novel object paper research robotic type view vision