Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis. (arXiv:2201.08174v1 [cs.CL])

Data-driven systems need to be evaluated to establish trust in the scientific
approach and its applicability. In particular, this is true for Knowledge Graph
(KG) Question Answering (QA), where complex data structures are made accessible
via natural-language interfaces. Evaluating the capabilities of these systems
has been a driver for the community for more than ten years while establishing
different KGQA benchmark datasets. However, comparing different approaches is
cumbersome. The lack of existing and curated leaderboards leads to a missing
global …

arxiv community crisis graph knowledge graph