Re-thinking Knowledge Graph Completion Evaluation from an Information Retrieval Perspective. (arXiv:2205.04105v1 [cs.CL] CROSS LISTED)

Knowledge graph completion (KGC) aims to infer missing knowledge triples
based on known facts in a knowledge graph. Current KGC research mostly follows
an entity ranking protocol, wherein the effectiveness is measured by the
predicted rank of a masked entity in a test triple. The overall performance is
then given by a micro(-average) metric over all individual answer entities. Due
to the incomplete nature of the large-scale knowledge bases, such an entity
ranking setting is likely affected by unlabelled top-ranked …

arxiv evaluation graph information knowledge knowledge graph perspective retrieval thinking