Closed Loop Interactive Embodied Reasoning for Robot Manipulation

arXiv:2404.15194v1 Announce Type: cross
Abstract: Embodied reasoning systems integrate robotic hardware and cognitive processes to perform complex tasks typically in response to a natural language query about a specific physical environment. This usually involves changing the belief about the scene or physically interacting and changing the scene (e.g. 'Sort the objects from lightest to heaviest'). In order to facilitate the development of such systems we introduce a new simulating environment that makes use of MuJoCo physics engine and high-quality renderer …

abstract arxiv belief cognitive cs.cv cs.ro embodied environment hardware interactive language loop manipulation natural natural language natural language query objects processes query reasoning robot robotic robot manipulation sort systems tasks type