Semantic Map-based Generation of Navigation Instructions

arXiv:2403.19603v1 Announce Type: cross
Abstract: We are interested in the generation of navigation instructions, either in their own right or as training material for robotic navigation task. In this paper, we propose a new approach to navigation instruction generation by framing the problem as an image captioning task using semantic maps as visual input. Conventional approaches employ a sequence of panorama images to generate navigation instructions. Semantic maps abstract away from visual details and fuse the information in multiple panorama …

arxiv cs.ai cs.cl cs.cv map navigation semantic type