Octopus v2: On-device language model for super agent

arXiv:2404.01744v1 Announce Type: new
Abstract: Language models have shown effectiveness in a variety of software applications, particularly in tasks related to automatic workflow. These models possess the crucial ability to call functions, which is essential in creating AI agents. Despite the high performance of large-scale language models in cloud environments, they are often associated with concerns over privacy and cost. Current on-device models for function calling face issues with latency and accuracy. Our research presents a new method that empowers …

abstract agent agents ai agents applications arxiv call cloud cloud environments cs.cl environments functions language language model language models performance scale software software applications tasks type workflow