"Which LLM should I use?": Evaluating LLMs for tasks performed by Undergraduate Computer Science Students in India

This study evaluates the effectiveness of various large language models (LLMs) in performing tasks common among undergraduate computer science students. Although a number of research studies in the computing education community have explored the possibility of using LLMs for a variety of tasks, there is a lack of comprehensive research comparing different LLMs and evaluating which LLMs are most effective for different tasks. Our research systematically assesses some of the publicly available LLMs such as Google Bard, ChatGPT, GitHub Copilot …

community computer computer science computing cs.cy cs.hc cs.lg education india language language models large language large language models llm llms possibility research science students studies study tasks undergraduate