TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants

arXiv:2405.02637v1 Announce Type: cross
Abstract: Conversational information seeking has evolved rapidly in the last few years with the development of Large Language Models (LLMs), providing the basis for interpreting and responding in a naturalistic manner to user requests. The extended TREC Interactive Knowledge Assistance Track (iKAT) collection aims to enable researchers to test and evaluate their Conversational Search Agents (CSA). The collection contains a set of 36 personalized dialogues over 20 different topics each coupled with a Personal Text Knowledge …

abstract arxiv assistants collection conversational cs.ai cs.cl cs.ir development information interactive knowledge language language models large language large language models llms test type