ChatGPT Role-play Dataset: Analysis of User Motives and Model Naturalness

arXiv:2403.18121v1 Announce Type: new
Abstract: Recent advances in interactive large language models like ChatGPT have revolutionized various domains; however, their behavior in natural and role-play conversation settings remains underexplored. In our study, we address this gap by deeply investigating how ChatGPT behaves during conversations in different settings by analyzing its interactions in both a normal way and a role-play setting. We introduce a novel dataset of broad range of human-AI conversations annotated with user motives and model naturalness to examine …

abstract advances analysis arxiv behavior chatgpt conversation conversations cs.cl cs.hc dataset domains gap however interactive language language models large language large language models natural role study type