NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning

arXiv:2403.07376v1 Announce Type: cross
Abstract: Vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an offline manner usually suffers from substantial domain gap between the VLN task and the LLM training corpus. This paper introduces a novel strategy …

arxiv boosting cs.ai cs.cl cs.cv cs.ro language llm navigation reasoning type via vision vision-and-language