CSEPrompts: A Benchmark of Introductory Computer Science Prompts

arXiv:2404.02540v1 Announce Type: new
Abstract: Recent advances in AI, machine learning, and NLP have led to the development of a new generation of Large Language Models (LLMs) that are trained on massive amounts of data and often have trillions of parameters. Commercial applications (e.g., ChatGPT) have made this technology available to the general public, thus making it possible to use LLMs to produce high-quality texts for academic and professional purposes. Schools and universities are aware of the increasing use of …

abstract advances applications arxiv benchmark chatgpt commercial computer computer science cs.cl data development language language models large language large language models llms machine machine learning massive nlp parameters prompts science technology type