"Where am I?" Scene Retrieval with Language

arXiv:2404.14565v1 Announce Type: new
Abstract: Natural language interfaces to embodied AI are becoming more ubiquitous in our daily lives. This opens further opportunities for language-based interaction with embodied agents, such as a user instructing an agent to execute some task in a specific location. For example, "put the bowls back in the cupboard next to the fridge" or "meet me at the intersection under the red sign." As such, we need methods that interface between natural language and map representations …

abstract agent agents arxiv cs.cv daily embodied embodied ai example interfaces language location natural natural language opportunities retrieval type