Creative Robot Tool Use with Large Language Models

TLDR: We introduce RoboTool, enabling robots to use tools creatively with large language models, which solves long-horizon hybrid discrete-continuous planning problems with the environment- and embodiment-related constraints. Tool use is an essential hallmark of advanced intelligence. Some animals can use tools to achieve goals that are infeasible without tools. For example, crows solve a complex physical puzzle using a series of tools, and apes use a tree branch to crack open nuts or fish termites with a stick. Beyond using …

advanced animals constraints continuous creative enabling environment example hallmark hybrid intelligence language language models large language large language models machine learning planning research robot robots the environment tool tools