LaTTe: Language Trajectory TransformEr. (arXiv:2208.02918v2 [cs.RO] UPDATED)

Natural language is one of the most intuitive ways to express human intent.
However, translating instructions and commands towards robotic motion
generation, and deployment in the real world, is far from being an easy task.
Indeed, combining robotic's inherent low-level geometric and kinodynamic
constraints with human's high-level semantic information reinvigorates and
raises new challenges to the task-design problem -- typically leading to task
or hardware specific solutions with a static set of action targets and
commands. This work instead proposes …

arxiv language transformer