Studying LLM Performance on Closed- and Open-source Data

arXiv:2402.15100v1 Announce Type: cross
Abstract: Large Language models (LLMs) are finding wide use in software engineering practice. These models are extremely data-hungry, and are largely trained on open-source (OSS) code distributed with permissive licenses. In terms of actual use however, a great deal of software development still occurs in the for-profit/proprietary sphere, where the code under development is not, and never has been, in the public domain; thus, many developers, do their work, and use LLMs, in settings where the …

abstract arxiv code cs.lg cs.se data deal development distributed engineering for-profit language language models large language large language models llm llm performance llms oss performance practice profit proprietary software software development software engineering source data sphere studying terms type