Explore and Explain: Self-supervised Navigation and Recounting

arXiv:2007.07268v1 Announce Type: cross
Abstract: Embodied AI has been recently gaining attention as it aims to foster the development of autonomous and intelligent agents. In this paper, we devise a novel embodied setting in which an agent needs to explore a previously unknown environment while recounting what it sees during the path. In this context, the agent needs to navigate the environment driven by an exploration goal, select proper moments for description, and output natural language descriptions of relevant objects …

abstract agent agents arxiv attention autonomous cs.ai cs.cl cs.cv cs.ro development embodied embodied ai environment explore intelligent navigation novel paper path type