Using language to give robots a better grasp of an open-ended world

By blending 2D images with foundation models to build 3D feature fields, a new MIT method helps robots understand and manipulate nearby objects with open-ended language prompts.

build computer science and technology computer vision feature fields foundation human-computer interaction images industry language machine learning manufacturing mit mit schwarzman college of computing natural language processing objects prompts research robotics robots school of engineering world