MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs

arXiv:2403.05814v1 Announce Type: new
Abstract: Despite advancements in on-topic dialogue systems, effectively managing topic shifts within dialogues remains a persistent challenge, largely attributed to the limited availability of training datasets. To address this issue, we propose Multi-Passage to Dialogue (MP2D), a data generation framework that automatically creates conversational question-answering datasets with natural topic transitions. By leveraging the relationships between entities in a knowledge graph, MP2D maps the flow of topics within a dialogue, effectively mirroring the dynamics of human conversation. …

abstract arxiv automated availability challenge conversational cs.ai cs.cl data datasets dialogue framework graphs issue knowledge knowledge graphs question shift systems training training datasets type