Octopus: On-device language model for function calling of software APIs

arXiv:2404.01549v1 Announce Type: new
Abstract: In the rapidly evolving domain of artificial intelligence, Large Language Models (LLMs) play a crucial role due to their advanced text processing and generation abilities. This study introduces a new strategy aimed at harnessing on-device LLMs in invoking software APIs. We meticulously compile a dataset derived from software API documentation and apply fine-tuning to LLMs with capacities of 2B, 3B and 7B parameters, specifically to enhance their proficiency in software API interactions. Our approach concentrates …

abstract advanced apis artificial artificial intelligence arxiv cs.cl cs.se dataset domain function intelligence language language model language models large language large language models llms processing role software strategy study text type