Towards A Human-in-the-Loop LLM Approach to Collaborative Discourse Analysis

arXiv:2405.03677v1 Announce Type: new
Abstract: LLMs have demonstrated proficiency in contextualizing their outputs using human input, often matching or beating human-level performance on a variety of tasks. However, LLMs have not yet been used to characterize synergistic learning in students' collaborative discourse. In this exploratory work, we take a first step towards adopting a human-in-the-loop prompt engineering approach with GPT-4-Turbo to summarize and categorize students' synergistic learning during collaborative discourse. Our preliminary findings suggest GPT-4-Turbo may be able to characterize …

abstract analysis arxiv collaborative cs.cl discourse exploratory however human llm llms loop performance students tasks type work