Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge

arXiv:2405.05253v1 Announce Type: new
Abstract: Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work to proprietary models. This has sparked considerable interest in the use of open source LLMs in education, but the quality of the feedback that such open models can produce remains understudied. This is a concern as providing flawed or …

abstract arxiv computing concerns cs.ai cs.cl cs.cy ethical ethical implications feedback gpt gpt-4 however judge language language models large language large language models llms open source open source language models privacy proprietary proprietary models students type work