Synthetic Data for Language-Guided Agents | Embodied AI Lecture series at AI2

Recent advances in vision and language modeling have been powered by truly massive datasets, often mined from the web. Instruction-following robots will also require large amounts of data to train and evaluate. However, images/videos/documents found on the web do not satisfy the needs of embodied agents, and data annotation is slow and expensive. Synthetic data is a promising alternative. In this talk, I’ll discuss two specific approaches. First, I’ll introduce our work generating synthetic navigation instructions at near-human quality, which …

agents ai ai2 data language synthetic data