Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation

arXiv:2310.07968v2 Announce Type: replace-cross
Abstract: Zero-Shot Object Navigation (ZSON) enables agents to navigate towards open-vocabulary objects in unknown environments. The existing works of ZSON mainly focus on following individual instructions to find generic object classes, neglecting the utilization of natural language interaction and the complexities of identifying user-specific objects. To address these limitations, we introduce Zero-shot Interactive Personalized Object Navigation (ZIPON), where robots need to navigate to personalized goal objects while engaging in conversations with users. To solve ZIPON, we …

abstract act agents arxiv complexities cs.cl cs.hc cs.ro environments focus interactive language natural natural language navigation objects open-world personalized robot robot navigation think type world zero-shot