A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cues. (arXiv:2207.11717v3 [cs.LG] UPDATED)

In a busy city street, a pedestrian surrounded by distractions can pick out a
single sign if it is relevant to their route. Artificial agents in outdoor
Vision-and-Language Navigation (VLN) are also confronted with detecting
supervisory signal on environment features and location in inputs. To boost the
prominence of relevant features in transformer-based architectures without
costly preprocessing and pretraining, we take inspiration from priority maps -
a mechanism described in neuropsychological studies. We implement a novel
priority map module and …

arxiv feature language location map navigation vision