Evaluating Class Membership Relations in Knowledge Graphs using Large Language Models

arXiv:2404.17000v1 Announce Type: new
Abstract: A backbone of knowledge graphs are their class membership relations, which assign entities to a given class. As part of the knowledge engineering process, we propose a new method for evaluating the quality of these relations by processing descriptions of a given entity and class using a zero-shot chain-of-thought classifier that uses a natural language intensional definition of a class. We evaluate the method using two publicly available knowledge graphs, Wikidata and CaLiGraph, and 7 …

abstract arxiv class cs.ai cs.cl engineering graphs knowledge knowledge graphs language language models large language large language models part process processing quality relations type