Successfully Guiding Humans with Imperfect Instructions by Highlighting Potential Errors and Suggesting Corrections

arXiv:2402.16973v1 Announce Type: cross
Abstract: This paper addresses the challenge of leveraging imperfect language models to guide human decision-making in the context of a grounded navigation task. We show that an imperfect instruction generation model can be complemented with an effective communication mechanism to become more successful at guiding humans. The communication mechanism we build comprises models that can detect potential hallucinations in instructions and suggest practical alternatives, and an intuitive interface to present that information to users. We show …

abstract arxiv become challenge communication context cs.ai cs.cl cs.hc decision errors guide highlighting human humans language language models making navigation paper show type